-- Logs begin at Thu 2022-07-14 18:09:14 UTC, end at Thu 2022-07-14 19:16:14 UTC. -- Jul 14 18:48:24.545172 dv-osbrick-849891-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 18:48:24.554740 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 18:48:24 2022] *** Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: nodename: dv-osbrick-849891-3-ceph Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: machine: x86_64 Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: clock source: unix Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: pcre jit disabled Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: detected number of CPU cores: 4 Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: current working directory: / Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: detected binary path: /usr/bin/uwsgi-core Jul 14 18:48:24.556793 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: your processes number limit is 47680 Jul 14 18:48:24.557416 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: your memory page size is 4096 bytes Jul 14 18:48:24.557416 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: detected max file descriptor number: 2048 Jul 14 18:48:24.557416 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: lock engine: pthread robust mutexes Jul 14 18:48:24.557416 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: thunder lock: enabled Jul 14 18:48:24.557416 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 18:48:24.557416 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 18:48:24.601841 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: Python main interpreter initialized at 0x55a4fee5c9c0 Jul 14 18:48:24.601841 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: python threads support enabled Jul 14 18:48:24.601841 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: your server socket listen backlog is limited to 100 connections Jul 14 18:48:24.601841 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: your mercy for graceful operations on workers is 90 seconds Jul 14 18:48:24.602164 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 18:48:24.602239 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: *** Operational MODE: preforking *** Jul 14 18:48:24.602484 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: *** uWSGI is running in multiple interpreter mode *** Jul 14 18:48:24.602484 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: spawned uWSGI master process (pid: 120829) Jul 14 18:48:24.602678 dv-osbrick-849891-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 14 18:48:24.603978 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: spawned uWSGI worker 1 (pid: 120840, cores: 1) Jul 14 18:48:24.603978 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: spawned uWSGI worker 2 (pid: 120841, cores: 1) Jul 14 18:48:24.603978 dv-osbrick-849891-3-ceph devstack@keystone.service[120829]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 18:48:30.266326 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:48:30.266326 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: from cryptography.utils import int_from_bytes Jul 14 18:48:30.267109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:48:30.267109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: from cryptography.utils import int_from_bytes Jul 14 18:48:30.267962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:48:30.267962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: from cryptography.utils import int_from_bytes Jul 14 18:48:30.268450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:48:30.268450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: from cryptography.utils import int_from_bytes Jul 14 18:48:30.315576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 18:48:30.315774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 18:48:30.315949 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 18:48:30.316047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] command line args: [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 18:48:30.316133 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 18:48:30.316232 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 18:48:30.316355 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] command line args: [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 18:48:30.316440 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ================================================================================ {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 18:48:30.316642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 18:48:30.316727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] admin_token = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.316807 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ================================================================================ {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 18:48:30.316886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] config_dir = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.317067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.317145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] admin_token = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.317251 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] config_source = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.317336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] config_dir = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.317473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] debug = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.317557 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.317629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319016 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] config_source = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319016 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] debug = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319016 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] insecure_debug = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] insecure_debug = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.319902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320184 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320466 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] list_limit = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320466 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] log_config_append = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] list_limit = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.320962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] log_config_append = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321088 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] log_dir = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321208 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] log_file = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] log_dir = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321545 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321668 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] log_file = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321865 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.321948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322020 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322137 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322717 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322806 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.322884 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323012 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323210 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323572 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323657 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323735 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.323962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] notification_format = cadf {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324182 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] notification_format = cadf {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324182 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324385 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324385 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] publish_errors = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324385 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324588 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324588 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] publish_errors = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.324930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325347 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] standard_threads = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] strict_password_check = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325572 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] standard_threads = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325648 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325648 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] use_eventlog = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325775 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] strict_password_check = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325851 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] use_journal = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325923 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.325994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] use_json = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] use_eventlog = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326137 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] use_stderr = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326214 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] use_journal = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] use_syslog = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] use_json = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326441 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] watch_log_file = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326510 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] use_stderr = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326580 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.326654 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] use_syslog = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.326813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.326899 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] watch_log_file = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:48:30.327069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.327146 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.327306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.327389 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.327556 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.327641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.327794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.327871 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328042 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328302 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328382 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328628 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.328868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329042 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329277 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329397 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.329999 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330244 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330364 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330835 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.330960 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331200 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331441 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331557 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.331906 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332022 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332269 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332386 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332512 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332865 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.332986 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333223 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333339 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333453 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333566 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333681 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.333917 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.334032 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.334146 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.334260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.334883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.334997 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.335192 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.335315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.335430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.335544 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.335664 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.335781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.335903 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336024 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336139 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336270 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336633 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336865 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.336979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337092 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337206 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337328 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337444 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337558 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337672 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337792 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.337915 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338038 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338161 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338395 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.338996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339731 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339846 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.339962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340082 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340631 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340745 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.340872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341661 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341786 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.341909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342160 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342641 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.342886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343003 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343241 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343472 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.343939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344500 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344616 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.344977 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345099 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.enabled = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345331 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345572 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.345915 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.enabled = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346030 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346271 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346398 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346637 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346752 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.346943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347528 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347767 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.347888 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348119 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348247 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348378 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348740 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348855 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.348970 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349092 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349209 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349332 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.349920 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.350583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.350700 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.350815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.350930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351286 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351517 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.351978 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] auth.external = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] auth.mapped = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.352812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353143 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] auth.password = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353509 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] auth.external = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353637 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] auth.token = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] auth.mapped = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.353996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] catalog.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354239 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354473 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] auth.password = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354706 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] auth.token = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354829 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.354954 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355070 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] catalog.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355417 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] credential.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355661 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355786 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] credential.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.355908 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356141 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356556 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] credential.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356789 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.356904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] credential.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357272 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357388 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357619 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357735 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.357979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358101 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358218 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358334 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358450 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358575 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.358926 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359165 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359631 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359747 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.359997 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360376 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.360973 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361205 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361398 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361749 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361865 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.361982 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362347 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362579 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.362946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363064 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363181 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363537 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363537 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.363988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364251 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364251 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.364930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.365056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.365175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.365292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.365408 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.365524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366249 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366482 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.366839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367057 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367057 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367537 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367653 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.367886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368006 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368131 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368274 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368393 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368509 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368625 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368741 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.368987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369575 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369808 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.369923 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370039 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370277 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370396 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.370931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371173 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371289 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.password = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371636 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.371993 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372109 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372239 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.password = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372741 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372858 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.372975 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373091 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373333 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373449 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373566 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373682 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.373922 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374758 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.374991 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375349 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375584 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375864 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.375983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.376108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.376285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.376405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.376522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.376638 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.376755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.376883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377118 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377234 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377350 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377455 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.377919 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378036 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378276 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378394 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378510 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378742 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378866 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.378983 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.379910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380026 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380142 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.380998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.381122 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.381285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] policy.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.381888 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382479 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382710 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] receipt.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382825 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.382950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383190 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] policy.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383538 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383666 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.383900 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384133 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] receipt.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384438 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384556 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384673 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384779 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.384893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.385008 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.385198 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.385356 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.385473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.385597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.385715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] revoke.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.385898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386029 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386381 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386498 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] role.cache_time = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386738 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] role.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386863 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.386980 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] role.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387096 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387220 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] role.list_limit = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] revoke.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387461 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387579 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387811 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.387927 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388042 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] role.cache_time = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388301 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] role.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388437 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388554 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] role.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388670 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388786 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] role.list_limit = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.388914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389033 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389149 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389266 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389499 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389623 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389741 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389858 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.389974 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390334 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390571 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.390927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391162 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391278 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391396 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391512 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391637 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391871 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.391987 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392103 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392248 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392379 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392499 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392731 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392731 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.392948 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393073 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393191 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393307 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393540 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393780 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.393898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394130 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394362 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394486 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394604 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.cache_time = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394835 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.394950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395066 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395190 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395308 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.provider = fernet {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395541 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395657 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395781 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.395899 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.396015 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.396420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.396542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.396660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.396840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.cache_time = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.396986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397221 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397337 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397453 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] trust.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397577 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.provider = fernet {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397813 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.397930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398287 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398406 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.398996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399114 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] trust.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399347 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.connection = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.399962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400080 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400478 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400732 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400851 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.400967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401118 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401118 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401584 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.connection = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401708 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401835 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.401953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402186 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402427 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402543 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402776 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.402893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403598 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403722 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403839 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.403956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=120840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:48:30.404188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=120841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 18:48:30.431764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.431992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.432236 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.432946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.433186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.433419 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.440760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.442023 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.468730 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.468958 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.470056 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.470289 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.520961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.521862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.571483 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.571715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.572675 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.572918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.635426 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.635651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.635875 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.635960 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.636096 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.636181 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.636340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.636437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.636554 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.636638 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.636845 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.637068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.659178 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.659410 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.659496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.659636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.659719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.659854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.659955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.660067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.660151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.660299 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.660382 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.660510 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.660595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.660757 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.673985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.674444 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.686873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.687945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.688034 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.688156 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=120840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.688275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.688404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.688627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=120841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 18:48:30.705221 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.705429 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 18:48:30.705766 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.705965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 18:48:30.706048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.706197 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 18:48:30.706282 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.706474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.706568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.706727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 18:48:30.706811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.706980 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.707061 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.707255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.707519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.707781 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.717981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.718259 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.718529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.718807 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.718892 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.719105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.719381 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.719671 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.727392 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.728322 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.730659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.730940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.731222 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.731500 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.731615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.731774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.731901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.732028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.732187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.732426 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.732511 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.732705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.732788 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.732983 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.733075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.733258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.733409 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.733526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.733693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.733973 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.734251 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.734523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.760169 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.761591 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.761909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.762189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.763324 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.763612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.767419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.767695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.767974 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.768966 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.769253 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.769538 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.775257 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.775499 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.776965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.777253 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.779939 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.780369 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.780654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.780938 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.781213 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.781489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.781751 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.781836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.782015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.782161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.782452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.782739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.783017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.783408 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.783569 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.783842 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.801309 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.801585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.803593 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.803886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.806812 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.808526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.810469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.810764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.812129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.812455 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.815728 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.817406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.819355 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.821033 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.823103 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.823400 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.823689 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.823982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.824288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.824579 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.824769 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.825074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.825362 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.825648 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.825926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.826206 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.843367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.843663 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.843930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.844191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.845114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.845412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.845686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.845951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.852637 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.854362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.854638 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.854783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.856551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.856834 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.857659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.857938 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.858225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.858514 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.858804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.859873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.860157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.860468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.860755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.861054 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.872102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.872406 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.872688 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.872968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.873246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.873515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.873787 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.874682 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.874967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.875254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.875542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.875829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.876106 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.876414 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.892180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.895286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.895439 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.899131 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.899355 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.900972 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.902474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.902597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.902873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.903154 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.904088 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.905749 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.906034 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.906322 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.910483 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.912103 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.913808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.915610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.915701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.915895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.916171 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.916469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.918934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.919228 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.919523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.919803 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.925455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.925744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.926956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.929435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.929730 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.930988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.935318 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=120840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.935598 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.935875 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.936149 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.936451 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.936719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.936998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.937264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.937529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.937803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.938084 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.938340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.938616 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.938881 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=120840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.938963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=120841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 18:48:30.939165 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.939454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.939736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.940064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.940366 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.940654 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.940926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.941209 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.941492 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.941780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.942045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.942321 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.942583 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=120841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 18:48:30.976798 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4fee5c9c0 pid: 120840 (default app) Jul 14 18:48:30.979994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7318-8a2a-45b1-bc57-08f1141c6996 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:30.980315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7318-8a2a-45b1-bc57-08f1141c6996 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:30.980596 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7318-8a2a-45b1-bc57-08f1141c6996 None None] PATH_INFO: `/v3` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:30.980733 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4fee5c9c0 pid: 120841 (default app) Jul 14 18:48:30.984855 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Thu Jul 14 18:48:30 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:38.875986 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5c70e-9ad3-4023-a7cb-73fe16804cd0 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:38.876582 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5c70e-9ad3-4023-a7cb-73fe16804cd0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:38.876582 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5c70e-9ad3-4023-a7cb-73fe16804cd0 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:38.880979 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 1/2] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:38.886302 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:38.886698 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:38.886861 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:38.961821 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: INFO dbcounter [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] Registered counter for database keystone Jul 14 18:48:38.982851 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG oslo_db.sqlalchemy.engines [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:48:38.989131 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writer thread running {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:48:39.164809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG passlib.handlers.bcrypt [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=120840) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 18:48:39.165433 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG passlib.handlers.bcrypt [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=120840) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 18:48:39.219511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:39.221146 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:39.344648 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 18:48:39.511988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5c70e-9ad3-4023-a7cb-73fe16804cd0 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:39.585951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: INFO dbcounter [None req-06e5c70e-9ad3-4023-a7cb-73fe16804cd0 None None] Registered counter for database keystone Jul 14 18:48:39.605231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG oslo_db.sqlalchemy.engines [None req-06e5c70e-9ad3-4023-a7cb-73fe16804cd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:48:39.611405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writer thread running {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:48:39.728841 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5c70e-9ad3-4023-a7cb-73fe16804cd0 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:39.733073 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9250f8-a7bd-4b8a-9184-b1e7be947ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:39.733730 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9250f8-a7bd-4b8a-9184-b1e7be947ffb admin admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:39.734012 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9250f8-a7bd-4b8a-9184-b1e7be947ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:39.734287 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9250f8-a7bd-4b8a-9184-b1e7be947ffb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:39.743106 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9250f8-a7bd-4b8a-9184-b1e7be947ffb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:39.793527 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1b9250f8-a7bd-4b8a-9184-b1e7be947ffb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 18:48:39.793817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9250f8-a7bd-4b8a-9184-b1e7be947ffb admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:39.803867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1324 bytes} [Thu Jul 14 18:48:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 18:48:39.809796 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:39.824045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe5a49-d108-4a37-a13f-94ffdfcfdd2c None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:39.828561 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947271a-0e38-4b5e-b502-f2e00a6a7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:39.829659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947271a-0e38-4b5e-b502-f2e00a6a7db0 admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:39.829943 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947271a-0e38-4b5e-b502-f2e00a6a7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:39.830229 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947271a-0e38-4b5e-b502-f2e00a6a7db0 admin admin] PATH_INFO: `/v3/projects/b6df883a091541ef907c5fc4143c65b5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:39.831844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947271a-0e38-4b5e-b502-f2e00a6a7db0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b6df883a091541ef907c5fc4143c65b5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:39.883948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8947271a-0e38-4b5e-b502-f2e00a6a7db0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 18:48:39.884321 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947271a-0e38-4b5e-b502-f2e00a6a7db0 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:39.888837 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 3/5] 10.222.0.72 () {56 vars in 1207 bytes} [Thu Jul 14 18:48:39 2022] GET /identity/v3/projects/b6df883a091541ef907c5fc4143c65b5 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:42.059700 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca75f7-1450-4a74-b4f1-7a4d60d2bf16 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:42.060275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca75f7-1450-4a74-b4f1-7a4d60d2bf16 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:42.060275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca75f7-1450-4a74-b4f1-7a4d60d2bf16 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:42.064410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 3/6] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:42.070268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09180f55-6a6a-4c33-8950-3afd814c4fae None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:42.070650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09180f55-6a6a-4c33-8950-3afd814c4fae None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:42.070822 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09180f55-6a6a-4c33-8950-3afd814c4fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:42.089925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-09180f55-6a6a-4c33-8950-3afd814c4fae None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:42.091457 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-09180f55-6a6a-4c33-8950-3afd814c4fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:42.099234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 4/7] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 14 18:48:42.121612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca75f7-1450-4a74-b4f1-7a4d60d2bf16 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:42.134097 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca75f7-1450-4a74-b4f1-7a4d60d2bf16 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:42.138335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629f063-8e00-4509-8c94-e3c9eb5a0f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:42.138956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f063-8e00-4509-8c94-e3c9eb5a0f08 admin admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:42.139242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f063-8e00-4509-8c94-e3c9eb5a0f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:42.139519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629f063-8e00-4509-8c94-e3c9eb5a0f08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:42.147761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629f063-8e00-4509-8c94-e3c9eb5a0f08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:42.149553 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629f063-8e00-4509-8c94-e3c9eb5a0f08 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:42.158318 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 4/8] 10.222.0.72 () {58 vars in 1324 bytes} [Thu Jul 14 18:48:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:48:42.163399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09180f55-6a6a-4c33-8950-3afd814c4fae None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:42.172687 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09180f55-6a6a-4c33-8950-3afd814c4fae None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:42.177102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a52c6-436e-464b-ba02-36b116bc5df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:42.178524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a52c6-436e-464b-ba02-36b116bc5df9 admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:42.178814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a52c6-436e-464b-ba02-36b116bc5df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:42.179093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a52c6-436e-464b-ba02-36b116bc5df9 admin admin] PATH_INFO: `/v3/users/0d863b3bf1f7404a89e5e672973c4874` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:42.180532 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a52c6-436e-464b-ba02-36b116bc5df9 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d863b3bf1f7404a89e5e672973c4874)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:42.182367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a52c6-436e-464b-ba02-36b116bc5df9 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:42.183918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 5/9] 10.222.0.72 () {56 vars in 1198 bytes} [Thu Jul 14 18:48:42 2022] GET /identity/v3/users/0d863b3bf1f7404a89e5e672973c4874 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:44.458176 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e5199-c8a0-4285-bf4e-5f4fc72f5c57 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:44.459213 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e5199-c8a0-4285-bf4e-5f4fc72f5c57 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:44.459299 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e5199-c8a0-4285-bf4e-5f4fc72f5c57 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:44.460930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 5/10] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:48:44.466015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9a407-865c-4633-a482-7d2eea5ad768 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:44.466449 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:44.466449 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:44.466641 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9a407-865c-4633-a482-7d2eea5ad768 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:44.466729 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:44.466815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9a407-865c-4633-a482-7d2eea5ad768 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:44.467919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 6/11] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:44.472805 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467f7e6-0ccf-473c-80a4-7b011f1d7eda None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:44.473097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467f7e6-0ccf-473c-80a4-7b011f1d7eda None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:44.473382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467f7e6-0ccf-473c-80a4-7b011f1d7eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:44.490708 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-2467f7e6-0ccf-473c-80a4-7b011f1d7eda None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:44.491934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-2467f7e6-0ccf-473c-80a4-7b011f1d7eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:44.506336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG passlib.handlers.bcrypt [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=120841) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 18:48:44.506764 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG passlib.handlers.bcrypt [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=120841) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 18:48:44.553018 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:44.554549 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:44.570965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 7/12] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:44.594635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467f7e6-0ccf-473c-80a4-7b011f1d7eda None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:44.618405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:44.656055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 6/13] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:44.680684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:44.701116 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467f7e6-0ccf-473c-80a4-7b011f1d7eda None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:44.734394 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:44.735041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:44.735324 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:44.735608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:44.782610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f85c94-30cb-4664-a34b-a2baa9141cae None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:44.785231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:44.825244 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:44.826244 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:44.826536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:44.826816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:44.840479 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:48:44.851953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:44.852967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:48:44.854010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 7/14] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:48:44.858992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:44.911599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:44.913163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:44.935584 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:44.957490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78e9c-f408-44fd-b592-8f2707876bc5 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:44.990500 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:44.991155 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:44.991440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:44.991715 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:44.992493 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:44.992802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:44.994220 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:45.006460 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 8/15] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:45.011107 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 8/16] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:48:45.012156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:45.016228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:45.039260 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:45.111029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d24b2-b3d9-4e4e-a291-922c9f841e8d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:45.113622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d025b-34fc-439d-8e18-d1dc015c70df None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:45.136162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:45.145927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:45.147340 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:45.147622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:45.147928 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] PATH_INFO: `/v3/users/0d863b3bf1f7404a89e5e672973c4874` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:45.149119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:45.149523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] RBAC: Authorizing `identity:get_user(user_id=0d863b3bf1f7404a89e5e672973c4874)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:45.149911 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:45.150199 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:45.150479 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:45.150978 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:45.152621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 9/17] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:48:45 2022] GET /identity/v3/users/0d863b3bf1f7404a89e5e672973c4874 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:45.157985 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:45.161260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:45.162752 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:48:45.185238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:45.186337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:45.192170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:48:45.192170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:48:45.192170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:48:45.192170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:48:45.192170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 9/18] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:48:45.192702 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:45.298612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b63b9-eea3-48e0-9448-65c0e8fbed83 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:45.332020 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:45.332709 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:45.332988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:45.333265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:45.334031 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:45.334345 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:45.335758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:45.352569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 10/19] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:45.358069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:45.366762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1d13-bfd5-4110-8bdc-b487d7725163 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:45.403497 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2512-bde8-4014-be41-879212e66c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:45.404367 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2512-bde8-4014-be41-879212e66c57 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:45.404655 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2512-bde8-4014-be41-879212e66c57 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:45.404936 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2512-bde8-4014-be41-879212e66c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:45.406225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca2512-bde8-4014-be41-879212e66c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:45.407725 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca2512-bde8-4014-be41-879212e66c57 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:45.409484 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 10/20] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:45.416066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:45.453954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:45.527527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6faab-d06e-486f-850a-8b891fb2a415 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:45.564712 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80662076-4b52-470d-943c-092583bcfdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:45.565381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80662076-4b52-470d-943c-092583bcfdd9 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:45.565671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80662076-4b52-470d-943c-092583bcfdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:45.565962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80662076-4b52-470d-943c-092583bcfdd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:45.566804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80662076-4b52-470d-943c-092583bcfdd9 None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.domain.id=default, user.id=0d863b3bf1f7404a89e5e672973c4874) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:45.567120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80662076-4b52-470d-943c-092583bcfdd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:45.568636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80662076-4b52-470d-943c-092583bcfdd9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:45.575549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 11/21] 10.222.0.72 () {56 vars in 1322 bytes} [Thu Jul 14 18:48:45 2022] GET /identity/v3/role_assignments?user.id=0d863b3bf1f7404a89e5e672973c4874&scope.domain.id=default&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:47.978014 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1202d-da7b-4e55-b026-d4992801f41d None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:47.978520 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1202d-da7b-4e55-b026-d4992801f41d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:47.978591 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1202d-da7b-4e55-b026-d4992801f41d None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:47.980224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 11/22] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:47.985607 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dad19-952b-4226-933d-9077ed4bb098 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:47.986015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dad19-952b-4226-933d-9077ed4bb098 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:47.986184 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dad19-952b-4226-933d-9077ed4bb098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.008760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-b35dad19-952b-4226-933d-9077ed4bb098 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:48.009963 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-b35dad19-952b-4226-933d-9077ed4bb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:48.098113 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 12/23] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:48.138365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1202d-da7b-4e55-b026-d4992801f41d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:48.150958 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14d02-2522-4488-9244-f9d5057cae00 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.151254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14d02-2522-4488-9244-f9d5057cae00 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.151539 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14d02-2522-4488-9244-f9d5057cae00 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.153303 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:48.160088 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e42e-20dc-49bc-a60b-4fa6bdb4f8a3 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.160407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e42e-20dc-49bc-a60b-4fa6bdb4f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.160695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959e42e-20dc-49bc-a60b-4fa6bdb4f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.193855 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-4959e42e-20dc-49bc-a60b-4fa6bdb4f8a3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:48.195082 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-4959e42e-20dc-49bc-a60b-4fa6bdb4f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:48.263652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:48.378406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1202d-da7b-4e55-b026-d4992801f41d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:48.389830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 14/25] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:48.433704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959e42e-20dc-49bc-a60b-4fa6bdb4f8a3 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:48.436709 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:48.437625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.437919 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.438202 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.472526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:48.475049 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:48:48.502050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:48.502897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:48.503692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:48:48.503692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:48:48.503692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:48:48.503692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:48:48.510254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 12/26] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:48:48.517042 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:48.546985 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:48.655854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959e42e-20dc-49bc-a60b-4fa6bdb4f8a3 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:48.720944 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90fc3f-7173-4bd2-901b-1358e8d6e692 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:48.738223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecf5d3-0db2-478c-8761-6827b83cd14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:48.739032 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecf5d3-0db2-478c-8761-6827b83cd14e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.739316 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecf5d3-0db2-478c-8761-6827b83cd14e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.739624 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecf5d3-0db2-478c-8761-6827b83cd14e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.766059 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecf5d3-0db2-478c-8761-6827b83cd14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-f0ecf5d3-0db2-478c-8761-6827b83cd14e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:48:48.775892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:48.776768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:48:48.777525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 15/27] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:48:48.778743 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa80b-78af-4219-8d7a-e4c704857ef6 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.778743 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa80b-78af-4219-8d7a-e4c704857ef6 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.778857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aa80b-78af-4219-8d7a-e4c704857ef6 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.780404 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 16/28] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:48.786448 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aa80b-78af-4219-8d7a-e4c704857ef6 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:48.786892 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d1d2e-d5df-4d7c-b9af-ad6669b7a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:48.787579 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d1d2e-d5df-4d7c-b9af-ad6669b7a06e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.787865 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d1d2e-d5df-4d7c-b9af-ad6669b7a06e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.788142 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d1d2e-d5df-4d7c-b9af-ad6669b7a06e None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.789001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d1d2e-d5df-4d7c-b9af-ad6669b7a06e None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:48.789659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d1d2e-d5df-4d7c-b9af-ad6669b7a06e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:48.794883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d1d2e-d5df-4d7c-b9af-ad6669b7a06e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:48.824610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:48.831500 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 13/29] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:48.832523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602b00-117b-40da-9b6e-8866d210791e None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.832802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602b00-117b-40da-9b6e-8866d210791e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.833113 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602b00-117b-40da-9b6e-8866d210791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.870731 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-09602b00-117b-40da-9b6e-8866d210791e None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:48.872262 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-09602b00-117b-40da-9b6e-8866d210791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:48.935026 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213aa80b-78af-4219-8d7a-e4c704857ef6 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:48.955531 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 14/30] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:48:48.956410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602b00-117b-40da-9b6e-8866d210791e None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:48.972707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:48.984786 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b52a8-1a91-470c-92c2-980d71caa72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:48.985974 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b52a8-1a91-470c-92c2-980d71caa72f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:48.987019 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b52a8-1a91-470c-92c2-980d71caa72f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:48.987497 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b52a8-1a91-470c-92c2-980d71caa72f None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:48.988576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b52a8-1a91-470c-92c2-980d71caa72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:48.989237 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b52a8-1a91-470c-92c2-980d71caa72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:48.991757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b52a8-1a91-470c-92c2-980d71caa72f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:49.006625 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 17/31] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:49.008553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdcac-d59a-40e9-85c5-ecbd07b8f515 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.009111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdcac-d59a-40e9-85c5-ecbd07b8f515 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.009680 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdcac-d59a-40e9-85c5-ecbd07b8f515 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.011201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 18/32] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:49.012221 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cdcac-d59a-40e9-85c5-ecbd07b8f515 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:49.080610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602b00-117b-40da-9b6e-8866d210791e None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:49.123595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:49.123595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.123595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.123595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.124003 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:49.124763 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:49.126452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:49.149558 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cdcac-d59a-40e9-85c5-ecbd07b8f515 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:49.186052 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ea03-096b-4c87-8bb0-eac89a7fcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:49.186723 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ea03-096b-4c87-8bb0-eac89a7fcbc9 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.187007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ea03-096b-4c87-8bb0-eac89a7fcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.187285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ea03-096b-4c87-8bb0-eac89a7fcbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.188033 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ea03-096b-4c87-8bb0-eac89a7fcbc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:49.189610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ea03-096b-4c87-8bb0-eac89a7fcbc9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:49.280826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 15/33] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:48:48 2022] POST /identity/v3/projects => generated 301 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:48:49.282325 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:49.327467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 19/34] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Jul 14 18:48:49 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:48:49.329043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9015ff-ca28-42ea-add5-c8dfd06e8f51 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.329346 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9015ff-ca28-42ea-add5-c8dfd06e8f51 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.329631 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9015ff-ca28-42ea-add5-c8dfd06e8f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.350438 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-9d9015ff-ca28-42ea-add5-c8dfd06e8f51 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:49.352050 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-9d9015ff-ca28-42ea-add5-c8dfd06e8f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:49.352384 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:49.407277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4ba3e-3f68-489c-b20e-5c4447fcb4de None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:49.437480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 20/35] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:48:49.448230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:49.449167 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.449460 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.449747 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] PATH_INFO: `/v3/users/0d863b3bf1f7404a89e5e672973c4874` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.451233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] RBAC: Authorizing `identity:get_user(user_id=0d863b3bf1f7404a89e5e672973c4874)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:49.460552 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:49.460552 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 16/36] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:48:49 2022] GET /identity/v3/users/0d863b3bf1f7404a89e5e672973c4874 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:49.466752 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9015ff-ca28-42ea-add5-c8dfd06e8f51 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:49.484875 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:49.561969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:49.606299 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9015ff-ca28-42ea-add5-c8dfd06e8f51 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:49.666079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84145d-75a9-4367-809d-a95381aa0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:49.666909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84145d-75a9-4367-809d-a95381aa0b2d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.667201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84145d-75a9-4367-809d-a95381aa0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.667590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84145d-75a9-4367-809d-a95381aa0b2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.668953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84145d-75a9-4367-809d-a95381aa0b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:49.670620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84145d-75a9-4367-809d-a95381aa0b2d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:49.672758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 21/37] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:49.674106 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ee16a-e843-4486-9f36-16a77787982f None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.674509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ee16a-e843-4486-9f36-16a77787982f None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.674800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ee16a-e843-4486-9f36-16a77787982f None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.676328 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 22/38] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:49.679864 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95c98-0bf9-4f8f-bf71-3ac07d513132 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:49.679989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ee16a-e843-4486-9f36-16a77787982f None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:49.714147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:49.730451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c3322-3619-4198-9f26-f4644e8bff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:49.731137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3322-3619-4198-9f26-f4644e8bff77 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.731429 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3322-3619-4198-9f26-f4644e8bff77 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.731711 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3322-3619-4198-9f26-f4644e8bff77 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.732540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c3322-3619-4198-9f26-f4644e8bff77 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:49.734040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c3322-3619-4198-9f26-f4644e8bff77 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:49.748811 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 17/39] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Jul 14 18:48:49 2022] POST /identity/v3/roles => generated 225 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:48:49.750164 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bef29-661f-43eb-a943-dc9d43e901f7 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.750459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bef29-661f-43eb-a943-dc9d43e901f7 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.750743 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bef29-661f-43eb-a943-dc9d43e901f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.769278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-a81bef29-661f-43eb-a943-dc9d43e901f7 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:49.771005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-a81bef29-661f-43eb-a943-dc9d43e901f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:49.820889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ee16a-e843-4486-9f36-16a77787982f None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:49.852896 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 18/40] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:48:49.854737 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fe246-cd02-4a9e-89be-b0002eb2770e None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.855110 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fe246-cd02-4a9e-89be-b0002eb2770e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.855470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fe246-cd02-4a9e-89be-b0002eb2770e None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.857462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 19/41] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:49.863220 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752b933-0c82-4a14-a6e4-5302bb70a1f2 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.863591 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752b933-0c82-4a14-a6e4-5302bb70a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.863843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752b933-0c82-4a14-a6e4-5302bb70a1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.872987 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:49.874773 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:49.875284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:49.875777 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] PATH_INFO: `/v3/domains/default/users/0d863b3bf1f7404a89e5e672973c4874/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:49.878342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0d863b3bf1f7404a89e5e672973c4874, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:49.880145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:49.885576 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-1752b933-0c82-4a14-a6e4-5302bb70a1f2 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:49.886862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-1752b933-0c82-4a14-a6e4-5302bb70a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:49.893174 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:49.899582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 23/42] 10.222.0.72 () {58 vars in 1361 bytes} [Thu Jul 14 18:48:49 2022] PUT /identity/v3/domains/default/users/0d863b3bf1f7404a89e5e672973c4874/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:48:49.901562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:49.995377 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 20/43] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:50.020646 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752b933-0c82-4a14-a6e4-5302bb70a1f2 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:50.047455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3624-a370-4ffd-b9ec-5d84ca44176e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:50.073669 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:50.093057 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:50.093720 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:50.094007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:50.094286 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:50.095043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:50.096456 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:50.112191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 24/44] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Jul 14 18:48:49 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:48:50.141608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752b933-0c82-4a14-a6e4-5302bb70a1f2 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:50.181795 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6005c-8a97-4a0f-9951-286cf1f8f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:50.182614 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6005c-8a97-4a0f-9951-286cf1f8f71e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:50.182900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6005c-8a97-4a0f-9951-286cf1f8f71e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:50.183178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6005c-8a97-4a0f-9951-286cf1f8f71e None admin] PATH_INFO: `/v3/domains/default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:50.184461 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6005c-8a97-4a0f-9951-286cf1f8f71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:50.185969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6005c-8a97-4a0f-9951-286cf1f8f71e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:50.187856 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 21/45] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:50.194189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:50.258964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:50.320878 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428be62e-a04d-428b-8e22-6d8b7e75c3e3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:50.356401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac39228-6c1e-4d1b-ab35-76bbea1c3bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:50.357066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac39228-6c1e-4d1b-ab35-76bbea1c3bb2 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:50.357354 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac39228-6c1e-4d1b-ab35-76bbea1c3bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:50.357633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac39228-6c1e-4d1b-ab35-76bbea1c3bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:50.358357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac39228-6c1e-4d1b-ab35-76bbea1c3bb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:50.359817 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac39228-6c1e-4d1b-ab35-76bbea1c3bb2 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:50.388176 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 25/46] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:48:50 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:48:52.144000 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee3ddc-cc2b-4759-966e-64d4aca497e9 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.144595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee3ddc-cc2b-4759-966e-64d4aca497e9 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.144595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee3ddc-cc2b-4759-966e-64d4aca497e9 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.146135 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 22/47] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:52.151148 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6aa6c-d49b-467d-ba98-c1d262b032e4 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.151541 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6aa6c-d49b-467d-ba98-c1d262b032e4 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.151809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6aa6c-d49b-467d-ba98-c1d262b032e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.168550 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-89c6aa6c-d49b-467d-ba98-c1d262b032e4 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:52.169737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-89c6aa6c-d49b-467d-ba98-c1d262b032e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:52.235032 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 26/48] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:48:52.259779 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee3ddc-cc2b-4759-966e-64d4aca497e9 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:52.362905 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee3ddc-cc2b-4759-966e-64d4aca497e9 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:52.376340 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:52.397293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:52.398021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.398308 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.398586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.408898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:48:52.417476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:52.418431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:48:52.419175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 23/49] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:48:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:48:52.424537 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6aa6c-d49b-467d-ba98-c1d262b032e4 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:52.467235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:52.527288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6aa6c-d49b-467d-ba98-c1d262b032e4 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:52.561490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e2a26-4e88-4734-ad29-e80d44832837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:52.562164 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e2a26-4e88-4734-ad29-e80d44832837 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.562458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e2a26-4e88-4734-ad29-e80d44832837 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.562741 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e2a26-4e88-4734-ad29-e80d44832837 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.563506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e2a26-4e88-4734-ad29-e80d44832837 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:52.563821 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e2a26-4e88-4734-ad29-e80d44832837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:52.565260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e2a26-4e88-4734-ad29-e80d44832837 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:52.573611 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 27/50] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:52.579124 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:52.620028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d517d-5166-4994-a0fb-717186d045f1 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.620357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d517d-5166-4994-a0fb-717186d045f1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.620647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d517d-5166-4994-a0fb-717186d045f1 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.622015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 28/51] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:48:52.626876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce69e5-8165-4fd5-8346-8c85ac54cc69 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.627173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce69e5-8165-4fd5-8346-8c85ac54cc69 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.627463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce69e5-8165-4fd5-8346-8c85ac54cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.644071 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-73ce69e5-8165-4fd5-8346-8c85ac54cc69 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:52.645329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-73ce69e5-8165-4fd5-8346-8c85ac54cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:52.681702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079eb0d-84b4-4fc9-95d4-9244c454454f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:52.712281 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 29/52] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:52.716504 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:52.717413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.717705 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.717988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] PATH_INFO: `/v3/users/0d863b3bf1f7404a89e5e672973c4874` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.719175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] RBAC: Authorizing `identity:get_user(user_id=0d863b3bf1f7404a89e5e672973c4874)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:52.720656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:52.722259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 24/53] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:48:52 2022] GET /identity/v3/users/0d863b3bf1f7404a89e5e672973c4874 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:52.728188 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce69e5-8165-4fd5-8346-8c85ac54cc69 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:52.736947 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:52.758355 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:52.779062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:52.828638 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce69e5-8165-4fd5-8346-8c85ac54cc69 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:52.836615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cde84-1556-449c-be56-d86acea12b80 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:52.863444 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:52.864268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.865089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.865368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.866552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:52.868016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:52.869662 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 30/54] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:52.872940 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:52.873755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:52.874054 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:52.874434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:52.875373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:52.875640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:52.877137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:52.879766 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 25/55] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:48:52.885685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:52.978166 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:52.981284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bfbb0-f292-4448-a967-26b8e1019a36 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:52.988482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afbee8-b3c8-43de-96b6-a30f8910ed76 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:52.997734 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:53.016656 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac60a9-8695-4c8b-b4ae-0b562c526011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:53.017320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac60a9-8695-4c8b-b4ae-0b562c526011 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:53.017610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac60a9-8695-4c8b-b4ae-0b562c526011 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:53.017893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac60a9-8695-4c8b-b4ae-0b562c526011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:53.018760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac60a9-8695-4c8b-b4ae-0b562c526011 None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.domain.id=default, user.id=0d863b3bf1f7404a89e5e672973c4874) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:53.019076 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac60a9-8695-4c8b-b4ae-0b562c526011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:53.020547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac60a9-8695-4c8b-b4ae-0b562c526011 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:53.023117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea4b10-8504-42ad-a88b-69ea152d8581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:53.023780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4b10-8504-42ad-a88b-69ea152d8581 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:53.024072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4b10-8504-42ad-a88b-69ea152d8581 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:53.024394 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4b10-8504-42ad-a88b-69ea152d8581 None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:53.025109 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea4b10-8504-42ad-a88b-69ea152d8581 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:53.026380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 31/56] 10.222.0.72 () {56 vars in 1322 bytes} [Thu Jul 14 18:48:52 2022] GET /identity/v3/role_assignments?user.id=0d863b3bf1f7404a89e5e672973c4874&scope.domain.id=default&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:53.026564 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea4b10-8504-42ad-a88b-69ea152d8581 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:53.055068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 26/57] 10.222.0.72 () {60 vars in 1140 bytes} [Thu Jul 14 18:48:52 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:48:55.275706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d5fa-2fba-4567-8bd6-8cbfb25a7d16 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:55.276254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d5fa-2fba-4567-8bd6-8cbfb25a7d16 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:55.276365 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d5fa-2fba-4567-8bd6-8cbfb25a7d16 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:55.277680 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 32/58] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:55.283116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded46df-455f-4c42-83c6-73d8ac0525f9 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:55.283535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded46df-455f-4c42-83c6-73d8ac0525f9 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:55.283692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded46df-455f-4c42-83c6-73d8ac0525f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:55.301016 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-7ded46df-455f-4c42-83c6-73d8ac0525f9 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:55.302212 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-7ded46df-455f-4c42-83c6-73d8ac0525f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:55.366901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 27/59] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:48:55.391859 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d5fa-2fba-4567-8bd6-8cbfb25a7d16 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:55.492122 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d5fa-2fba-4567-8bd6-8cbfb25a7d16 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:55.525249 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fec04-573f-4758-9183-5fc70ec4c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:55.526105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fec04-573f-4758-9183-5fc70ec4c552 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:55.526335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fec04-573f-4758-9183-5fc70ec4c552 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:55.526616 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fec04-573f-4758-9183-5fc70ec4c552 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:55.527801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fec04-573f-4758-9183-5fc70ec4c552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:55.529268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fec04-573f-4758-9183-5fc70ec4c552 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:55.530871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 33/60] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:55.536490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded46df-455f-4c42-83c6-73d8ac0525f9 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:55.623218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:55.634809 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded46df-455f-4c42-83c6-73d8ac0525f9 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:55.667823 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33b576-551b-4883-9e01-97434d1b9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:55.668510 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33b576-551b-4883-9e01-97434d1b9374 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:55.668798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33b576-551b-4883-9e01-97434d1b9374 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:55.669075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33b576-551b-4883-9e01-97434d1b9374 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:55.669776 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33b576-551b-4883-9e01-97434d1b9374 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:55.671237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33b576-551b-4883-9e01-97434d1b9374 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:55.695975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 28/61] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:48:55 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:48:59.141539 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdca7d2-71ee-49cd-bf63-4ee03018e9c8 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.142440 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdca7d2-71ee-49cd-bf63-4ee03018e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.142982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdca7d2-71ee-49cd-bf63-4ee03018e9c8 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.144564 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 34/62] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:59.150001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf450-582a-44f1-a152-6b49515a94f0 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.150810 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf450-582a-44f1-a152-6b49515a94f0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.151271 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf450-582a-44f1-a152-6b49515a94f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.177920 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-9d7bf450-582a-44f1-a152-6b49515a94f0 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:59.179488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-9d7bf450-582a-44f1-a152-6b49515a94f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:59.258547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e1dc-c1a6-4b33-8a1c-9330dd5e7e6b None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.259185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e1dc-c1a6-4b33-8a1c-9330dd5e7e6b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.259679 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e1dc-c1a6-4b33-8a1c-9330dd5e7e6b None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.261280 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 35/63] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:59.271853 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afbcb-a36b-446b-aa4a-dd5e598ca83f None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.277357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afbcb-a36b-446b-aa4a-dd5e598ca83f None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.277843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afbcb-a36b-446b-aa4a-dd5e598ca83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.289680 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 29/64] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:48:59.304679 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-579afbcb-a36b-446b-aa4a-dd5e598ca83f None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:59.306171 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-579afbcb-a36b-446b-aa4a-dd5e598ca83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:59.336633 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf450-582a-44f1-a152-6b49515a94f0 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:59.347666 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:59.397529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 36/65] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:59.399190 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070e9d-6629-465b-b8d0-dc4e9ff03eef None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.399683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070e9d-6629-465b-b8d0-dc4e9ff03eef None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.400132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070e9d-6629-465b-b8d0-dc4e9ff03eef None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.401692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 37/66] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:59.409722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d481-c70a-4871-bcf9-d0a391bf78a7 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.410222 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d481-c70a-4871-bcf9-d0a391bf78a7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.410681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d481-c70a-4871-bcf9-d0a391bf78a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.436139 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-2140d481-c70a-4871-bcf9-d0a391bf78a7 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:59.438326 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-2140d481-c70a-4871-bcf9-d0a391bf78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:59.445255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:59.478732 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf450-582a-44f1-a152-6b49515a94f0 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:59.519300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:59.520268 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.521159 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.521512 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.530642 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 38/67] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:48:59.531967 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d481-c70a-4871-bcf9-d0a391bf78a7 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:59.544945 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:48:59.556861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:59.557900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:48:59.558658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:48:59.561649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 30/68] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:48:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:48:59.562556 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:59.652470 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:59.664428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d481-c70a-4871-bcf9-d0a391bf78a7 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:59.681090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b35052-7a14-4009-bd60-7d1dac9ee9ed None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:59.703777 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:59.704620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.704907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.705186 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.716066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:48:59.716754 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1782f7-90d4-4f36-b230-1f7335bf7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:59.717568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1782f7-90d4-4f36-b230-1f7335bf7d61 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.717862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1782f7-90d4-4f36-b230-1f7335bf7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.718147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1782f7-90d4-4f36-b230-1f7335bf7d61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.720821 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:48:59.724481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:59.725474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:48:59.726509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 39/69] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:48:59.731109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:59.733187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1782f7-90d4-4f36-b230-1f7335bf7d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-0a1782f7-90d4-4f36-b230-1f7335bf7d61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:48:59.741448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:48:59.742450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:48:59.743482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 31/70] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:48:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:48:59.744498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e18f-7df4-47d9-9dfb-db7839872faa None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.744498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e18f-7df4-47d9-9dfb-db7839872faa None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.744498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e18f-7df4-47d9-9dfb-db7839872faa None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.745670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 32/71] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:59.748309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ea2e-5d73-4fb6-8c3e-3496a981d9a7 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.748606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ea2e-5d73-4fb6-8c3e-3496a981d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.748893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ea2e-5d73-4fb6-8c3e-3496a981d9a7 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.750349 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 33/72] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:48:59.750988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ea2e-5d73-4fb6-8c3e-3496a981d9a7 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:59.834529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5326e4-2f75-4395-bc3a-5430b202909a None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:59.852948 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ea2e-5d73-4fb6-8c3e-3496a981d9a7 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:59.867543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:59.868238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.868533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.868814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.869560 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:59.869874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:59.871282 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:59.884676 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 40/73] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:48:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:59.884676 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:48:59.887482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b673e-c554-44e0-b889-aa4939834a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:48:59.888156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b673e-c554-44e0-b889-aa4939834a5c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.888483 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b673e-c554-44e0-b889-aa4939834a5c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.888768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b673e-c554-44e0-b889-aa4939834a5c None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.889523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b673e-c554-44e0-b889-aa4939834a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:48:59.889838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b673e-c554-44e0-b889-aa4939834a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:48:59.891238 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b673e-c554-44e0-b889-aa4939834a5c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:48:59.898778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:59.900051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 34/74] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:48:59.901470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237254-1163-4a9f-ac7f-7cc6720ba19a None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.901764 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237254-1163-4a9f-ac7f-7cc6720ba19a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.902047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237254-1163-4a9f-ac7f-7cc6720ba19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:48:59.919158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ed237254-1163-4a9f-ac7f-7cc6720ba19a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:48:59.920313 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ed237254-1163-4a9f-ac7f-7cc6720ba19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:48:59.972698 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:48:59.987515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 35/75] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:48:59.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3553ad8-e2c3-496f-a9f2-361de8df276c None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:48:59.989696 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cba0-a6b4-4190-a80d-d0f7aa3c9e9c None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:48:59.989994 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cba0-a6b4-4190-a80d-d0f7aa3c9e9c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:48:59.990282 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cba0-a6b4-4190-a80d-d0f7aa3c9e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.010941 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-5417cba0-a6b4-4190-a80d-d0f7aa3c9e9c None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:00.012341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-5417cba0-a6b4-4190-a80d-d0f7aa3c9e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:00.023588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.024301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.024589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.024870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.025620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:00.025933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.027310 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.035424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 41/76] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:48:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:00.036306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.081682 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 36/77] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:00.082805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417cba0-a6b4-4190-a80d-d0f7aa3c9e9c None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.122115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.147159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a250d4-a32b-4bf6-a96f-37f4a3407b24 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.181048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.181867 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.182158 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.182445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.182952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417cba0-a6b4-4190-a80d-d0f7aa3c9e9c None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.196039 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.197565 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.199231 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 42/78] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:00.199993 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.204777 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.222130 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.223011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.223303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.223626 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] PATH_INFO: `/v3/users/0d863b3bf1f7404a89e5e672973c4874` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.224866 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] RBAC: Authorizing `identity:get_user(user_id=0d863b3bf1f7404a89e5e672973c4874)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.226355 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.227981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 37/79] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/users/0d863b3bf1f7404a89e5e672973c4874 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:00.228843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.303732 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8966a9-fddb-46d0-84f2-3a3741c33888 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.334021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00594cc-beda-4343-9f8d-49307685948d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.337153 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.337952 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.338243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.338523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.340426 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.350031 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:00.357994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:00.358814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:00.359588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 43/80] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:00.360337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.372554 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.373462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.373755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.374035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.375244 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.376740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.383230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 38/81] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:00.383230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.436374 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.464925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18266314-a475-405b-b571-be6a37e9f4aa None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.484550 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c391-c1e5-4121-bd3a-5b8377aea653 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.499645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.500484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.500777 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.501064 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.502254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.503784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.506336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 44/82] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:00.506941 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.520581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.521242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.521535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.521820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.568024 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.588758 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.590223 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.607585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07d5c2-95cf-4dff-bb1d-2503df01d598 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.640411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.641063 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.641354 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.641639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.642234 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.688679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 39/83] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:00.689424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.713699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.715187 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.774705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.787279 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d578b-09c0-4051-b1f0-219e05d51185 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.817329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 45/84] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:00.818505 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.820677 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.821350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.821644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.821930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.822683 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:00.822997 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.824438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.832786 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 40/85] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:00.833438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:00.852116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.919338 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d01267-4834-48d9-b240-353e8d2113df None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.933881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32863e4-98d8-4a8b-8c2b-e15ed90ff00d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:00.952454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.953119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.953407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.953687 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.970574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:00.971249 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:00.971539 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:00.971830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:00.972570 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:00.974578 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:00.983615 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:00.994668 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 41/86] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:00 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:00.995401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.038722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.040688 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.072881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:01.108495 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7facc-f385-4eb8-83a5-92133443d4b8 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:01.149758 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:01.150653 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:01.150942 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:01.151210 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:01.152474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.153942 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.155675 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 42/87] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:01.156482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.157926 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 46/88] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:01.159659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.228325 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:01.277845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01548-3b0c-452b-93fb-d1cba4b0c902 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:01.306731 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445e10-eeb1-4408-9e67-496b86cf275e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:01.320626 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:01.321523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:01.321813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:01.322092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:01.323327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.324844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.326795 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 47/89] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:01 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:01.327250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.351980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:01.352931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:01.353223 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:01.353506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:01.354701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.356147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.358051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 43/90] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:01 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:01.358664 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.378462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:01.455891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af218c1-7aec-415e-88b4-c9b71208e937 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:01.494649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:01.501981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:01.502912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:01.503197 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:01.503528 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:01.505256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7e44f-09a5-4d2a-b05f-b8cecaff66c4 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:01.505384 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.506816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.508778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 48/91] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:01 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:01.509314 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.547575 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:01.548339 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:01.548624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:01.548962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:01.549908 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=79253e4cb8314900b37b63f77c8efa9e) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:01.550227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.551944 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.561415 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 44/92] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:01 2022] GET /identity/v3/role_assignments?user.id=79253e4cb8314900b37b63f77c8efa9e&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=ae946283d08e403cba50982b7ee3d73a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:01.562247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.642832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b3dcd-1d06-4fc7-835a-2504d8f4a133 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:01.654232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:01.693998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf644-432c-42cc-ad0c-aa6b6cc670e3 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:01.732253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:01.732931 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:01.733222 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:01.733507 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:01.749194 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:01.749796 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:01.750083 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:01.750360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:01.751216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=0d863b3bf1f7404a89e5e672973c4874) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:01.751531 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.753044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.764305 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 45/93] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:01 2022] GET /identity/v3/role_assignments?user.id=0d863b3bf1f7404a89e5e672973c4874&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:01.766800 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:01.904599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:01.905945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:01.918041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:01.993163 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b62504-202d-4ad7-99e0-064063dead77 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:02.057651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:02.058243 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:02.058531 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:02.058813 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:02.059655 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] RBAC: Adding query filter params (role.id=db905eb62199424a865391fb08241ee4, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=79253e4cb8314900b37b63f77c8efa9e) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:02.059970 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:02.061467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:02.071498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:02.083003 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 46/94] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:01 2022] GET /identity/v3/role_assignments?user.id=79253e4cb8314900b37b63f77c8efa9e&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=db905eb62199424a865391fb08241ee4 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:02.119026 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 49/95] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:02.124755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:02.278804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde46f4-2283-47d4-af2e-32ae86e05fb3 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:02.328070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94b435-16a0-4832-870c-e7661e5989ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:02.328898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b435-16a0-4832-870c-e7661e5989ec None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:02.329186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b435-16a0-4832-870c-e7661e5989ec None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:02.329464 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94b435-16a0-4832-870c-e7661e5989ec None admin] PATH_INFO: `/v3/projects/663e511ee3674d7c81e6fae669f21bc7` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:02.330666 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94b435-16a0-4832-870c-e7661e5989ec None admin] RBAC: Authorizing `identity:get_project(project_id=663e511ee3674d7c81e6fae669f21bc7)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:02.332116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94b435-16a0-4832-870c-e7661e5989ec None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:02.334066 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 47/96] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:02 2022] GET /identity/v3/projects/663e511ee3674d7c81e6fae669f21bc7 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:02.339860 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:02.467639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:02.476254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058efbcd-1f73-4bd9-9ebf-69262740ebac None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:02.524857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46a24-c4e3-4f91-9df9-575675ecdbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:02.525534 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46a24-c4e3-4f91-9df9-575675ecdbb3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:02.525822 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46a24-c4e3-4f91-9df9-575675ecdbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:02.526104 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46a24-c4e3-4f91-9df9-575675ecdbb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:02.526961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46a24-c4e3-4f91-9df9-575675ecdbb3 None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=663e511ee3674d7c81e6fae669f21bc7, user.id=79253e4cb8314900b37b63f77c8efa9e) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:02.527283 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46a24-c4e3-4f91-9df9-575675ecdbb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:02.528808 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46a24-c4e3-4f91-9df9-575675ecdbb3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:02.536518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 50/97] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:02 2022] GET /identity/v3/role_assignments?user.id=79253e4cb8314900b37b63f77c8efa9e&scope.project.id=663e511ee3674d7c81e6fae669f21bc7&role.id=ae946283d08e403cba50982b7ee3d73a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:03.957675 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5456-8db8-44e5-af36-68af62f6cbac None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:03.958383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5456-8db8-44e5-af36-68af62f6cbac None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:03.958383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5456-8db8-44e5-af36-68af62f6cbac None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:03.959629 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 48/98] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:03.965153 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78e30-48f1-46dc-8244-42cdf7a0cd63 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:03.965988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78e30-48f1-46dc-8244-42cdf7a0cd63 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:03.966503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78e30-48f1-46dc-8244-42cdf7a0cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:03.984233 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-cda78e30-48f1-46dc-8244-42cdf7a0cd63 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:03.985862 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-cda78e30-48f1-46dc-8244-42cdf7a0cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:04.064531 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 51/99] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:04.090064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5456-8db8-44e5-af36-68af62f6cbac None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:04.170477 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:04.216253 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5456-8db8-44e5-af36-68af62f6cbac None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:04.257377 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656221b-e853-43a2-ba3f-14f073831525 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.257665 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656221b-e853-43a2-ba3f-14f073831525 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.257952 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656221b-e853-43a2-ba3f-14f073831525 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.259336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 52/100] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:04.264458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12bd28-32c4-4a95-b3dc-c078cf6b06c7 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.264757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12bd28-32c4-4a95-b3dc-c078cf6b06c7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.265045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12bd28-32c4-4a95-b3dc-c078cf6b06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.286908 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:04.287671 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.287962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.288267 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.304661 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-8f12bd28-32c4-4a95-b3dc-c078cf6b06c7 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:04.305969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-8f12bd28-32c4-4a95-b3dc-c078cf6b06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:04.317174 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:04.324943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:04.325801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:04.326551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:04.332725 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 49/101] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:04.337095 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:04.399894 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 53/102] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:04.445934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12bd28-32c4-4a95-b3dc-c078cf6b06c7 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:04.501559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:04.544178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9b86-5be5-44f9-b799-138dcc0ed5fb None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:04.594452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:04.613603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:04.615108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.615400 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.615851 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.616469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:04.616787 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:04.618203 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:04.630748 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 50/103] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:04.638374 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:04.646301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12bd28-32c4-4a95-b3dc-c078cf6b06c7 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:04.691104 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ef881-ca43-48db-81c0-bd8064d72c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:04.692027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef881-ca43-48db-81c0-bd8064d72c6f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.692495 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef881-ca43-48db-81c0-bd8064d72c6f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.692785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef881-ca43-48db-81c0-bd8064d72c6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.697772 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef881-ca43-48db-81c0-bd8064d72c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:04.699555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef881-ca43-48db-81c0-bd8064d72c6f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:04.701399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 54/104] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:04.702539 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec899b-7b6e-47d0-a03e-7ad3436a9f38 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.702732 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec899b-7b6e-47d0-a03e-7ad3436a9f38 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.703020 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec899b-7b6e-47d0-a03e-7ad3436a9f38 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.708300 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 55/105] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:04.708895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec899b-7b6e-47d0-a03e-7ad3436a9f38 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:04.798488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc0e7-1c5d-483f-8139-c3ee016b9584 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:04.852017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad223-accd-4275-b2e4-2ce738ccbdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:04.852930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad223-accd-4275-b2e4-2ce738ccbdee None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.853219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad223-accd-4275-b2e4-2ce738ccbdee None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.853500 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad223-accd-4275-b2e4-2ce738ccbdee None admin] PATH_INFO: `/v3/users/0090397446564209a6d867c03a901d05` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.889226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:04.893229 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ad223-accd-4275-b2e4-2ce738ccbdee None admin] RBAC: Authorizing `identity:get_user(user_id=0090397446564209a6d867c03a901d05)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:04.894747 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ad223-accd-4275-b2e4-2ce738ccbdee None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:04.900001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 51/106] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:04 2022] GET /identity/v3/users/0090397446564209a6d867c03a901d05 => generated 289 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:04.903555 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f7d0-276a-47da-8376-ab56c4960417 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.903847 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f7d0-276a-47da-8376-ab56c4960417 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.904134 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f7d0-276a-47da-8376-ab56c4960417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.910022 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec899b-7b6e-47d0-a03e-7ad3436a9f38 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:04.943271 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-6e69f7d0-276a-47da-8376-ab56c4960417 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:04.944549 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-6e69f7d0-276a-47da-8376-ab56c4960417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:04.969127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:04.969809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:04.970103 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:04.973440 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:04.973986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:04.979442 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:05.030576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 56/107] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:49:04 2022] POST /identity/v3/projects => generated 302 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:05.031241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:05.042828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:05.091184 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 52/108] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:05.133327 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f7d0-276a-47da-8376-ab56c4960417 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:05.174498 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd46e9-4229-4bb0-a9b9-18d1b30e69fa None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:05.226882 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ab2f-6f03-4a09-a6de-403cb096ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:05.227562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ab2f-6f03-4a09-a6de-403cb096ce67 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.227858 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ab2f-6f03-4a09-a6de-403cb096ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.228152 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ab2f-6f03-4a09-a6de-403cb096ce67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.258632 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:05.319943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f7d0-276a-47da-8376-ab56c4960417 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:05.364410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172145d8-8d80-4eaf-b4ca-07ec937d5ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:05.365151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172145d8-8d80-4eaf-b4ca-07ec937d5ed7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.365440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172145d8-8d80-4eaf-b4ca-07ec937d5ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.365718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172145d8-8d80-4eaf-b4ca-07ec937d5ed7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.380658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172145d8-8d80-4eaf-b4ca-07ec937d5ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:05.385927 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ab2f-6f03-4a09-a6de-403cb096ce67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:05.387502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ab2f-6f03-4a09-a6de-403cb096ce67 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-172145d8-8d80-4eaf-b4ca-07ec937d5ed7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:05.389723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:05.391242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 53/109] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:05.393087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0834b1-e5ef-4d49-903d-44e3d81b8ab9 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.394549 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0834b1-e5ef-4d49-903d-44e3d81b8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.394549 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0834b1-e5ef-4d49-903d-44e3d81b8ab9 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.400254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 54/110] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:05.401227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0834b1-e5ef-4d49-903d-44e3d81b8ab9 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:05.461166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:05.534093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 57/111] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:05.539021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efb918-b8cd-4875-996c-8e6b232929be None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.539021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efb918-b8cd-4875-996c-8e6b232929be None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.539021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efb918-b8cd-4875-996c-8e6b232929be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.548618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0834b1-e5ef-4d49-903d-44e3d81b8ab9 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:05.557630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-b6efb918-b8cd-4875-996c-8e6b232929be None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:05.559322 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-b6efb918-b8cd-4875-996c-8e6b232929be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:05.594145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eadb7d-6562-4b9a-9fae-85218e9f7907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:05.595813 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eadb7d-6562-4b9a-9fae-85218e9f7907 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.596273 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eadb7d-6562-4b9a-9fae-85218e9f7907 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.596960 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eadb7d-6562-4b9a-9fae-85218e9f7907 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.598309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eadb7d-6562-4b9a-9fae-85218e9f7907 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:05.599045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eadb7d-6562-4b9a-9fae-85218e9f7907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:05.600656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eadb7d-6562-4b9a-9fae-85218e9f7907 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:05.604832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:05.612770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 55/112] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:05.615046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc2f2-c916-47d2-9be3-495c78fa2d0d None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.615540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc2f2-c916-47d2-9be3-495c78fa2d0d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.616026 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc2f2-c916-47d2-9be3-495c78fa2d0d None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.617544 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 56/113] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:05.622434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc2f2-c916-47d2-9be3-495c78fa2d0d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:05.652503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 58/114] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:05.653728 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efb918-b8cd-4875-996c-8e6b232929be None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:05.760318 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:05.766507 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc2f2-c916-47d2-9be3-495c78fa2d0d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:05.767926 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efb918-b8cd-4875-996c-8e6b232929be None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:05.807154 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a3bb3-78d1-4db7-86fe-6e40b1ecf83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:05.808097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3bb3-78d1-4db7-86fe-6e40b1ecf83c None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.808438 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3bb3-78d1-4db7-86fe-6e40b1ecf83c None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.808722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3bb3-78d1-4db7-86fe-6e40b1ecf83c None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.810434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a3bb3-78d1-4db7-86fe-6e40b1ecf83c None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:05.812000 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a3bb3-78d1-4db7-86fe-6e40b1ecf83c None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:05.813738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:05.814073 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 59/115] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:05 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:05.815043 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.815613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.816100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.817585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:05.819548 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:05.819856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3021a-cb10-4728-b323-b62fbcf637e2 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:05.820155 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3021a-cb10-4728-b323-b62fbcf637e2 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:05.820577 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3021a-cb10-4728-b323-b62fbcf637e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:05.822117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 57/116] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:05 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:05.823064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:05.838705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-7ad3021a-cb10-4728-b323-b62fbcf637e2 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:05.840034 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7ad3021a-cb10-4728-b323-b62fbcf637e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:05.880678 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:05.917460 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 60/117] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:05.924255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3021a-cb10-4728-b323-b62fbcf637e2 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:05.977874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bb90-9d03-4571-8959-b8a43374abf9 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.015062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.016012 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.016425 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.016807 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.028373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:06.037547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:06.038703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:06.039946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:06.041656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 58/118] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:06.042693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.046950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3021a-cb10-4728-b323-b62fbcf637e2 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.074301 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:06.085757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.086993 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.087575 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.088335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.089844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:06.091538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:06.093506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 61/119] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:05 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:06.098737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.140919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:06.154015 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd5480-775f-448d-a74c-ad512ea9a456 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.190753 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.191430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.191716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.192303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.192876 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] RBAC: Adding query filter params (role.id=b2444542d70b4a3a9fcf9b6c5d0a7303, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=0090397446564209a6d867c03a901d05) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:06.193254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:06.194642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:06.208232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 59/120] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/role_assignments?user.id=0090397446564209a6d867c03a901d05&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:06.208232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.214368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f315a8d-4eda-44b2-b60e-d22796cd3bd2 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.257300 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ad323-d367-4531-adb7-bdaaea601746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.258133 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ad323-d367-4531-adb7-bdaaea601746 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.258422 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ad323-d367-4531-adb7-bdaaea601746 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.258704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ad323-d367-4531-adb7-bdaaea601746 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.280940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ad323-d367-4531-adb7-bdaaea601746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-935ad323-d367-4531-adb7-bdaaea601746 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:06.292697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:06.293836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:06.294794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:06.303581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 62/121] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:06.303581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4cf9-5bad-406e-b8bc-2ed5a22a7b66 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.303581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4cf9-5bad-406e-b8bc-2ed5a22a7b66 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.303581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4cf9-5bad-406e-b8bc-2ed5a22a7b66 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.305731 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 63/122] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:06.309179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4cf9-5bad-406e-b8bc-2ed5a22a7b66 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.348395 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:06.363284 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88b4f-2912-4cf1-861b-bb5ceffc9612 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.414178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.415532 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.416039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.416567 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.417519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:06.418055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:06.419635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:06.429243 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 60/123] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:06.430591 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.436302 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:06.442673 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4cf9-5bad-406e-b8bc-2ed5a22a7b66 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.479809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6d778-0be9-44e4-a033-497629585b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.480742 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d778-0be9-44e4-a033-497629585b46 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.481031 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d778-0be9-44e4-a033-497629585b46 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.481619 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d778-0be9-44e4-a033-497629585b46 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/79253e4cb8314900b37b63f77c8efa9e/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.483646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6d778-0be9-44e4-a033-497629585b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=8587c9b4473e46e5ba5e45a48be5f54b, user_id=79253e4cb8314900b37b63f77c8efa9e, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:06.485358 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6d778-0be9-44e4-a033-497629585b46 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:06.517048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 64/124] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:06 2022] PUT /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/79253e4cb8314900b37b63f77c8efa9e/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:06.518673 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8efa-b431-4929-b602-8b6fab69cf6b None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.518995 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8efa-b431-4929-b602-8b6fab69cf6b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.519264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb8efa-b431-4929-b602-8b6fab69cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.543958 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-9ccb8efa-b431-4929-b602-8b6fab69cf6b None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:06.545241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-9ccb8efa-b431-4929-b602-8b6fab69cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:06.568385 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411acb7-37b2-4cbf-9678-e7761bc6abd9 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.610567 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.611682 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.612227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.612824 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.614590 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:06.615190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:06.616879 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:06.627201 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 61/125] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:06.628935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.634602 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 65/126] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:06.636405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8efa-b431-4929-b602-8b6fab69cf6b None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.673607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:06.756023 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:06.779387 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb8efa-b431-4929-b602-8b6fab69cf6b None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.794275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0e92-b3de-4a52-8690-f6e8aeed7b96 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.827257 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.829127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.829614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.830092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.831490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:06.833770 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:06.835934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 66/127] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:06.837172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.854322 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:06.855286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:06.855663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:06.856011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] PATH_INFO: `/v3/users/0d863b3bf1f7404a89e5e672973c4874` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:06.857305 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] RBAC: Authorizing `identity:get_user(user_id=0d863b3bf1f7404a89e5e672973c4874)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:06.858828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:06.860659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 62/128] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/users/0d863b3bf1f7404a89e5e672973c4874 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:06.861490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:06.974635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063aa22b-522f-443b-9d7b-dc833e799db6 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:06.990268 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:07.021676 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5bf83-069b-4c7e-87c4-eb520735ca18 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:07.045745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.048044 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.050519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.050986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.072793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:07.082380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:07.083769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:07.084597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:07.087289 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 67/129] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:07.088246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:07.098757 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.099639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.099932 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.100256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.101478 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:07.103441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:07.105595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 63/130] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:06 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:07.106716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:07.113836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:07.237071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e6aa3-7c94-4672-a8ca-71e16c1e8d6e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:07.277746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1d436-bd79-402c-9dae-bdeb622195ca None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:07.279527 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.288691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.288985 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.289275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.290384 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:07.290702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:07.292224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:07.305486 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 64/131] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:07.306311 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:07.314061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.314940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.315237 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.315526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.317301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:07.318804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:07.320555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 68/132] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:07 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:07.321331 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:07.344120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:07.465479 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:07.483524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a8ae-bed7-470c-8554-2ecd17e06756 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:07.500399 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1efe-48f3-4cab-b6c5-7d1e201cc042 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:07.540815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.542135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.542674 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.543165 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.545270 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:07.546950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:07.554519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 69/133] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:07 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:07.556092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:07.561041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.562141 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.562581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.563031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/79253e4cb8314900b37b63f77c8efa9e/roles/db905eb62199424a865391fb08241ee4` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.566516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] RBAC: Authorizing `identity:create_grant(project_id=8587c9b4473e46e5ba5e45a48be5f54b, user_id=79253e4cb8314900b37b63f77c8efa9e, role_id=db905eb62199424a865391fb08241ee4)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:07.570492 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:07.597242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 65/134] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:07 2022] PUT /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/79253e4cb8314900b37b63f77c8efa9e/roles/db905eb62199424a865391fb08241ee4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:07.598487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:07.743894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:07.765411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7aec-b025-4d45-bd51-4425b6e8c74e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:07.793918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3b91-6161-41a1-93da-6c4865ad4064 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:07.836827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.837758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.838055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.838341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/0d863b3bf1f7404a89e5e672973c4874/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.842291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] RBAC: Authorizing `identity:create_grant(project_id=8587c9b4473e46e5ba5e45a48be5f54b, user_id=0d863b3bf1f7404a89e5e672973c4874, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:07.843836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:07.866993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa18fc-b037-43c4-aee0-6543fcb25888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:07.868240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 70/135] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:07 2022] PUT /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/0d863b3bf1f7404a89e5e672973c4874/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:07.868605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa18fc-b037-43c4-aee0-6543fcb25888 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.868947 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa18fc-b037-43c4-aee0-6543fcb25888 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.869242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa18fc-b037-43c4-aee0-6543fcb25888 None admin] PATH_INFO: `/v3/projects/663e511ee3674d7c81e6fae669f21bc7` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.876148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa18fc-b037-43c4-aee0-6543fcb25888 None admin] RBAC: Authorizing `identity:get_project(project_id=663e511ee3674d7c81e6fae669f21bc7)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:07.877893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa18fc-b037-43c4-aee0-6543fcb25888 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:07.880757 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 66/136] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:07 2022] GET /identity/v3/projects/663e511ee3674d7c81e6fae669f21bc7 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:07.886401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:07.908964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:07.991474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f444-a448-4a93-95f2-0faace5ef192 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:07.991778 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f444-a448-4a93-95f2-0faace5ef192 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:07.992036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f444-a448-4a93-95f2-0faace5ef192 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:07.993501 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 67/137] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:07.999990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1c77-da5d-4331-90ed-e7cedcc947ef None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:08.000324 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1c77-da5d-4331-90ed-e7cedcc947ef None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:08.000598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1c77-da5d-4331-90ed-e7cedcc947ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:08.037513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-b03b1c77-da5d-4331-90ed-e7cedcc947ef None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:08.038661 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-b03b1c77-da5d-4331-90ed-e7cedcc947ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:08.046303 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe5f1-e4c1-4214-a752-32d6b5ebee55 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:08.085219 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:08.086185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:08.086485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:08.086836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] PATH_INFO: `/v3/projects/663e511ee3674d7c81e6fae669f21bc7/users/79253e4cb8314900b37b63f77c8efa9e/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:08.089989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] RBAC: Authorizing `identity:create_grant(project_id=663e511ee3674d7c81e6fae669f21bc7, user_id=79253e4cb8314900b37b63f77c8efa9e, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:08.091473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:08.113409 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 71/138] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:07 2022] PUT /identity/v3/projects/663e511ee3674d7c81e6fae669f21bc7/users/79253e4cb8314900b37b63f77c8efa9e/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:08.153481 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 68/139] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:08.192719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:08.277638 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:08.315278 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de867e-7075-435f-9aad-da4daeee3847 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:08.354109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695fc9d-35b2-4f3f-8703-712078bc277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:08.354898 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695fc9d-35b2-4f3f-8703-712078bc277b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:08.355240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695fc9d-35b2-4f3f-8703-712078bc277b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:08.355530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695fc9d-35b2-4f3f-8703-712078bc277b None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:08.356855 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695fc9d-35b2-4f3f-8703-712078bc277b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:08.358414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695fc9d-35b2-4f3f-8703-712078bc277b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:08.360398 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 72/140] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:08.367125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b1c77-da5d-4331-90ed-e7cedcc947ef None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:08.446532 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:08.480835 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b1c77-da5d-4331-90ed-e7cedcc947ef None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:08.517975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7eb6a-9575-47d2-89a7-632c181521a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:08.518662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7eb6a-9575-47d2-89a7-632c181521a4 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:08.518953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7eb6a-9575-47d2-89a7-632c181521a4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:08.519239 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7eb6a-9575-47d2-89a7-632c181521a4 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:08.520594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7eb6a-9575-47d2-89a7-632c181521a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:08.522132 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7eb6a-9575-47d2-89a7-632c181521a4 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:08.545040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 69/141] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:08 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:09.000610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68720ae-4f76-47d0-a1c6-b11a504ea745 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.001006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68720ae-4f76-47d0-a1c6-b11a504ea745 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.001187 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68720ae-4f76-47d0-a1c6-b11a504ea745 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.002574 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 73/142] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:09.009056 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c23f-b165-4efa-b223-95195ff05855 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.009354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c23f-b165-4efa-b223-95195ff05855 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.009638 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c23f-b165-4efa-b223-95195ff05855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.028594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-10a5c23f-b165-4efa-b223-95195ff05855 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:09.029848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-10a5c23f-b165-4efa-b223-95195ff05855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:09.111093 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 70/143] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:09.136806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68720ae-4f76-47d0-a1c6-b11a504ea745 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:09.284228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68720ae-4f76-47d0-a1c6-b11a504ea745 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:09.329622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:09.330485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.330782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.331076 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.342527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:09.345722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:09.356793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:09.357683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:09.358892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 74/144] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:09.364689 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c23f-b165-4efa-b223-95195ff05855 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:09.435722 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:09.497739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c23f-b165-4efa-b223-95195ff05855 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:09.534450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:09.535060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.535483 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.536350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.537114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:09.537468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:09.538889 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:09.548263 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 71/145] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:09.554147 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:09.669626 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbc49-e016-4317-aea6-ac3b83d50f87 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:09.710737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca4889-5088-4d3e-94d5-18a9c168fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:09.711625 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca4889-5088-4d3e-94d5-18a9c168fa31 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.711913 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca4889-5088-4d3e-94d5-18a9c168fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.712265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca4889-5088-4d3e-94d5-18a9c168fa31 None admin] PATH_INFO: `/v3/users/0090397446564209a6d867c03a901d05` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.713533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca4889-5088-4d3e-94d5-18a9c168fa31 None admin] RBAC: Authorizing `identity:get_user(user_id=0090397446564209a6d867c03a901d05)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:09.715008 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca4889-5088-4d3e-94d5-18a9c168fa31 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:09.716742 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 75/146] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:09 2022] GET /identity/v3/users/0090397446564209a6d867c03a901d05 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:09.722182 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:09.772484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9006e-773a-4bb0-95a7-e46d71a7598e None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.772811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9006e-773a-4bb0-95a7-e46d71a7598e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.773049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9006e-773a-4bb0-95a7-e46d71a7598e None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.774419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 76/147] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:09.779420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e575154-028f-40a6-bf39-3abec74efc68 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.779774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e575154-028f-40a6-bf39-3abec74efc68 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.779993 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e575154-028f-40a6-bf39-3abec74efc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.804844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-3e575154-028f-40a6-bf39-3abec74efc68 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:09.806025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-3e575154-028f-40a6-bf39-3abec74efc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:09.908238 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73f64-6744-4f3f-85f5-6ee71395c7c3 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:09.937886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:09.946103 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 77/148] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:09.950952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:09.985795 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:09.986680 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:09.986963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:09.987237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:09.989484 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:09.990933 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:09.993108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 72/149] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:09 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:09.998756 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e575154-028f-40a6-bf39-3abec74efc68 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:10.013790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:10.150864 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e575154-028f-40a6-bf39-3abec74efc68 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:10.191219 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:10.192712 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:10.193004 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:10.193288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/0090397446564209a6d867c03a901d05/roles/b2444542d70b4a3a9fcf9b6c5d0a7303` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:10.195441 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8587c9b4473e46e5ba5e45a48be5f54b, user_id=0090397446564209a6d867c03a901d05, role_id=b2444542d70b4a3a9fcf9b6c5d0a7303)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:10.196945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:10.214855 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 78/150] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:09 2022] PUT /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/users/0090397446564209a6d867c03a901d05/roles/b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:10.240341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f64115-5245-4b65-926e-d082c4b5e896 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:10.299162 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:10.300041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:10.300364 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:10.300643 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:10.318898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:10.327123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:10.328065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:10.329329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 73/151] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:10.334979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:10.433900 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:10.483220 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776763f9-effa-4651-95c5-fc8e29c03ee4 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:10.528714 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:10.529399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:10.529686 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:10.529963 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:10.530730 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:10.531041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:10.532484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:10.542994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 79/152] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:10.548475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:10.640594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:10.698403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51673-04d2-4267-beb8-2f279ec9ff18 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:10.740896 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:10.742007 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:10.742430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:10.742843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:10.745629 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:10.747470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:10.749573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 74/153] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:10 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:10.755857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:10.889380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4261d18-6916-47f7-8d75-0139da5b46fe None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:10.910005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:10.938846 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:10.939518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:10.939805 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:10.940085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:11.030373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:11.031786 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:11.156997 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 80/154] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:11.164616 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:11.360192 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a36ed-d9c7-4f43-9488-82dcfda06862 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:11.396883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747e362-fb06-4f10-9c8b-2e64ea0dc72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:11.398103 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e362-fb06-4f10-9c8b-2e64ea0dc72f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:11.398594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e362-fb06-4f10-9c8b-2e64ea0dc72f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:11.399067 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e362-fb06-4f10-9c8b-2e64ea0dc72f None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:11.400494 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747e362-fb06-4f10-9c8b-2e64ea0dc72f None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:11.402176 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747e362-fb06-4f10-9c8b-2e64ea0dc72f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:11.404075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 75/155] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:11 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:11.404591 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:11.416229 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:11.468308 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:11.581962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efbdc1-de29-4cee-93e8-8014999caf74 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:11.622862 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b5695-39ce-4f21-bc42-ad403ec5aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:11.623452 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b5695-39ce-4f21-bc42-ad403ec5aa83 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:11.623740 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b5695-39ce-4f21-bc42-ad403ec5aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:11.624018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b5695-39ce-4f21-bc42-ad403ec5aa83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:11.624896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b5695-39ce-4f21-bc42-ad403ec5aa83 None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=79253e4cb8314900b37b63f77c8efa9e) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:11.625210 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b5695-39ce-4f21-bc42-ad403ec5aa83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:11.626687 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b5695-39ce-4f21-bc42-ad403ec5aa83 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:11.637297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 81/156] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:11 2022] GET /identity/v3/role_assignments?user.id=79253e4cb8314900b37b63f77c8efa9e&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=ae946283d08e403cba50982b7ee3d73a => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:11.666983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363148b-f303-4977-b20b-bf5d18e0b382 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:11.667961 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363148b-f303-4977-b20b-bf5d18e0b382 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:11.668483 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363148b-f303-4977-b20b-bf5d18e0b382 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:11.670203 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 76/157] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:11.676265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c5a9-fc6f-4034-a21a-303f2810a25a None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:11.676560 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c5a9-fc6f-4034-a21a-303f2810a25a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:11.676882 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3c5a9-fc6f-4034-a21a-303f2810a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:11.702510 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-e4a3c5a9-fc6f-4034-a21a-303f2810a25a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:11.704189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-e4a3c5a9-fc6f-4034-a21a-303f2810a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:11.803023 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 82/158] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:11.860549 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363148b-f303-4977-b20b-bf5d18e0b382 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:11.991650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363148b-f303-4977-b20b-bf5d18e0b382 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:12.029668 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:12.030860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.031365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.031875 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.044847 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:12.054025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:12.054874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:12.055670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:12.058400 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 77/159] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:12.064064 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3c5a9-fc6f-4034-a21a-303f2810a25a None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:12.086322 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:12.176565 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3c5a9-fc6f-4034-a21a-303f2810a25a None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:12.221556 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59317b62-1dee-445b-910a-c2c0a17fc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:12.222616 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317b62-1dee-445b-910a-c2c0a17fc6e3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.223655 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317b62-1dee-445b-910a-c2c0a17fc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.224127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317b62-1dee-445b-910a-c2c0a17fc6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.225168 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317b62-1dee-445b-910a-c2c0a17fc6e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:12.225667 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317b62-1dee-445b-910a-c2c0a17fc6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:12.227242 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317b62-1dee-445b-910a-c2c0a17fc6e3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:12.239429 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 83/160] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:12.246062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:12.309218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:12.366727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e6ad-85a7-484a-8414-39a2be20528c None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.366992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e6ad-85a7-484a-8414-39a2be20528c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.367278 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e6ad-85a7-484a-8414-39a2be20528c None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.373023 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 84/161] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:12.378084 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39ffb-d03e-486b-8661-1621a49810e8 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.378368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39ffb-d03e-486b-8661-1621a49810e8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.378647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39ffb-d03e-486b-8661-1621a49810e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.399297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e5d0-fa92-47ae-a49f-e22d06340d8f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:12.406391 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-7cf39ffb-d03e-486b-8661-1621a49810e8 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:12.407592 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7cf39ffb-d03e-486b-8661-1621a49810e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:12.464964 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:12.466366 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.466875 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.467369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.469002 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:12.470697 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:12.474110 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 78/162] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:12 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:12.479343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:12.545560 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 85/163] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:12.621966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39ffb-d03e-486b-8661-1621a49810e8 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:12.635002 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35254ee-b4a3-4b70-bb07-b42fabc26439 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:12.635599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:12.648537 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:12.683697 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:12.684406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.684648 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.684927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.777994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39ffb-d03e-486b-8661-1621a49810e8 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:12.810488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:12.811888 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:12.816753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f448d6-6725-4a7c-aa01-3f08285384f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:12.818563 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f448d6-6725-4a7c-aa01-3f08285384f3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.818847 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f448d6-6725-4a7c-aa01-3f08285384f3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.819123 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f448d6-6725-4a7c-aa01-3f08285384f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.833085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f448d6-6725-4a7c-aa01-3f08285384f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-a5f448d6-6725-4a7c-aa01-3f08285384f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:12.841471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:12.842415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:12.843652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 86/164] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:12.844876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52307-61f4-4681-96e0-a6ebddb4655c None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:12.845138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52307-61f4-4681-96e0-a6ebddb4655c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:12.846876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52307-61f4-4681-96e0-a6ebddb4655c None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:12.846876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 87/165] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:12.850551 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52307-61f4-4681-96e0-a6ebddb4655c None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:12.927376 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:12.965734 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52307-61f4-4681-96e0-a6ebddb4655c None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:13.003287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29784ac5-dade-4f44-86b8-cf88cf71ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:13.003962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784ac5-dade-4f44-86b8-cf88cf71ada1 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.004299 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784ac5-dade-4f44-86b8-cf88cf71ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.004715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29784ac5-dade-4f44-86b8-cf88cf71ada1 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.005475 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29784ac5-dade-4f44-86b8-cf88cf71ada1 None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:13.005925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29784ac5-dade-4f44-86b8-cf88cf71ada1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:13.007321 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29784ac5-dade-4f44-86b8-cf88cf71ada1 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:13.016776 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 88/166] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:13.017799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60bf07-779b-4861-bcce-83fb641effb6 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.018092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60bf07-779b-4861-bcce-83fb641effb6 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.018375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60bf07-779b-4861-bcce-83fb641effb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.041174 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-7a60bf07-779b-4861-bcce-83fb641effb6 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:13.042716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7a60bf07-779b-4861-bcce-83fb641effb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:13.070988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 79/167] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:13.071784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:13.088297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:13.184151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1607ea-1012-49ec-bb57-81fa9f11ce95 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:13.194735 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 89/168] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:13.196406 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60bf07-779b-4861-bcce-83fb641effb6 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:13.266053 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:13.267307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.267816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.268324 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] PATH_INFO: `/v3/users/79253e4cb8314900b37b63f77c8efa9e` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.277864 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] RBAC: Authorizing `identity:get_user(user_id=79253e4cb8314900b37b63f77c8efa9e)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:13.279620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:13.282634 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 80/169] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:13 2022] GET /identity/v3/users/79253e4cb8314900b37b63f77c8efa9e => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:13.283621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:13.285891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:13.335330 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60bf07-779b-4861-bcce-83fb641effb6 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:13.382608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:13.383736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.384459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.384750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.392014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:13.393511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:13.395286 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 90/170] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:13 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:13.396054 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:13.438927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:13.478683 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb593-1451-4595-a9e9-9906bb295e9d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:13.554093 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdf45a-0484-44e0-ab26-66d5240eac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:13.554909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdf45a-0484-44e0-ab26-66d5240eac44 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.555195 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdf45a-0484-44e0-ab26-66d5240eac44 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.555466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdf45a-0484-44e0-ab26-66d5240eac44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.578117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdf45a-0484-44e0-ab26-66d5240eac44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-aabdf45a-0484-44e0-ab26-66d5240eac44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:13.586586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:13.587470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:13.588708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 81/171] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:13.600813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11571f8-1855-4ff8-9be3-5dc34a490c79 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:13.603244 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71b653-65de-47b3-a11f-8fec6baa2a6f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.603536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71b653-65de-47b3-a11f-8fec6baa2a6f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.603813 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71b653-65de-47b3-a11f-8fec6baa2a6f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.612104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 82/172] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:13 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:13.612974 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71b653-65de-47b3-a11f-8fec6baa2a6f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:13.674872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:13.683237 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1a8c-1b00-4580-b7c8-c19c9536e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:13.683911 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1a8c-1b00-4580-b7c8-c19c9536e62d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.684228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1a8c-1b00-4580-b7c8-c19c9536e62d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.684502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1a8c-1b00-4580-b7c8-c19c9536e62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.801679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71b653-65de-47b3-a11f-8fec6baa2a6f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:13.838980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:13.839566 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:13.841211 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:13.841211 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:13.841211 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] RBAC: Adding query filter params (role.id=db905eb62199424a865391fb08241ee4, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=79253e4cb8314900b37b63f77c8efa9e) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:13.841491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:13.848259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:13.850472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1a8c-1b00-4580-b7c8-c19c9536e62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:13.850596 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 83/173] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:13 2022] GET /identity/v3/role_assignments?user.id=79253e4cb8314900b37b63f77c8efa9e&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=db905eb62199424a865391fb08241ee4 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:13.851475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:13.852861 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1a8c-1b00-4580-b7c8-c19c9536e62d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:13.880783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:13.991545 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e7184-5656-44b2-a222-06ada96944c2 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:14.070167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 91/174] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:14.071365 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b894-a073-4f08-9b95-2d7fc6c677a8 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.071667 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b894-a073-4f08-9b95-2d7fc6c677a8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.071955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b894-a073-4f08-9b95-2d7fc6c677a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.078282 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:14.078990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.079278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.079558 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.080366 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:14.080682 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:14.084225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:14.109518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-4c41b894-a073-4f08-9b95-2d7fc6c677a8 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:14.110287 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 84/175] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:14.111251 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:14.111581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-4c41b894-a073-4f08-9b95-2d7fc6c677a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:14.143212 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:14.220760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 92/176] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:14.221554 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b894-a073-4f08-9b95-2d7fc6c677a8 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:14.279993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:14.325065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b519d3a-d662-42d0-ba64-f39fbb51b056 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:14.366852 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b894-a073-4f08-9b95-2d7fc6c677a8 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:14.369366 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:14.370204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.370490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.370768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] PATH_INFO: `/v3/projects/663e511ee3674d7c81e6fae669f21bc7` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.371994 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] RBAC: Authorizing `identity:get_project(project_id=663e511ee3674d7c81e6fae669f21bc7)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:14.373543 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:14.375452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 85/177] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:14 2022] GET /identity/v3/projects/663e511ee3674d7c81e6fae669f21bc7 => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:14.376029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:14.403646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460196dd-9469-48b5-8c60-b6795b1b2f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:14.404631 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460196dd-9469-48b5-8c60-b6795b1b2f21 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.404924 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460196dd-9469-48b5-8c60-b6795b1b2f21 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.405199 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460196dd-9469-48b5-8c60-b6795b1b2f21 None admin] PATH_INFO: `/v3/users/0d863b3bf1f7404a89e5e672973c4874` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.406400 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460196dd-9469-48b5-8c60-b6795b1b2f21 None admin] RBAC: Authorizing `identity:get_user(user_id=0d863b3bf1f7404a89e5e672973c4874)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:14.407888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460196dd-9469-48b5-8c60-b6795b1b2f21 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:14.409629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 93/178] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:14 2022] GET /identity/v3/users/0d863b3bf1f7404a89e5e672973c4874 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:14.411510 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c48b-565c-45d8-bf05-9995b799a6b5 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.411806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c48b-565c-45d8-bf05-9995b799a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.412092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c48b-565c-45d8-bf05-9995b799a6b5 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.413348 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 94/179] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:14.414912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274207da-428b-49c6-a21d-c55c0dee87b6 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.415215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274207da-428b-49c6-a21d-c55c0dee87b6 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.415512 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274207da-428b-49c6-a21d-c55c0dee87b6 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.416966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 95/180] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:14.421508 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328032e-de66-44a2-b8ff-1b5e41148f49 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.421799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328032e-de66-44a2-b8ff-1b5e41148f49 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.422079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328032e-de66-44a2-b8ff-1b5e41148f49 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.423356 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 96/181] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:14.424063 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328032e-de66-44a2-b8ff-1b5e41148f49 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:14.449733 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:14.484224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991a56a-7ee9-4377-9c55-d39f1574128c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:14.521457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:14.522243 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.522523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.522791 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.524628 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:14.531507 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328032e-de66-44a2-b8ff-1b5e41148f49 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:14.533705 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:14.542178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:14.543035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 86/182] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:14.548659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:14.565610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6daa2-4907-466a-add1-ada647f1a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:14.566258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6daa2-4907-466a-add1-ada647f1a70b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.566568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6daa2-4907-466a-add1-ada647f1a70b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.566842 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6daa2-4907-466a-add1-ada647f1a70b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.567666 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6daa2-4907-466a-add1-ada647f1a70b None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=663e511ee3674d7c81e6fae669f21bc7, user.id=79253e4cb8314900b37b63f77c8efa9e) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:14.567977 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6daa2-4907-466a-add1-ada647f1a70b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:14.569456 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6daa2-4907-466a-add1-ada647f1a70b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:14.575135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 97/183] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:14 2022] GET /identity/v3/role_assignments?user.id=79253e4cb8314900b37b63f77c8efa9e&scope.project.id=663e511ee3674d7c81e6fae669f21bc7&role.id=ae946283d08e403cba50982b7ee3d73a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:14.576294 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e4a3-4ba8-4f24-87ea-e90a897f451a None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.576581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e4a3-4ba8-4f24-87ea-e90a897f451a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.576875 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e4a3-4ba8-4f24-87ea-e90a897f451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.604693 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-a3a1e4a3-4ba8-4f24-87ea-e90a897f451a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:14.606159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-a3a1e4a3-4ba8-4f24-87ea-e90a897f451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:14.654247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8a9ca-3e39-4aed-a6fc-8cd1d5af826d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:14.690067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 98/184] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:14.691180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a34ac-1cf8-4960-8d8d-abeefe94242d None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.691467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a34ac-1cf8-4960-8d8d-abeefe94242d None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.691779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a34ac-1cf8-4960-8d8d-abeefe94242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.692066 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:14.692759 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.693051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.693330 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.718043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-392a34ac-1cf8-4960-8d8d-abeefe94242d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:14.719265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-392a34ac-1cf8-4960-8d8d-abeefe94242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:14.734657 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:14.770458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:14.780819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:14.782311 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:14.803359 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 99/185] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:14.805759 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff8ff-78fc-426b-9549-5bd538dbdaa4 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:14.806056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff8ff-78fc-426b-9549-5bd538dbdaa4 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:14.806340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff8ff-78fc-426b-9549-5bd538dbdaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:14.824262 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-0abff8ff-78fc-426b-9549-5bd538dbdaa4 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:14.825423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-0abff8ff-78fc-426b-9549-5bd538dbdaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:14.897285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 87/186] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:14.897840 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 100/187] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:14.898141 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:14.898251 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff8ff-78fc-426b-9549-5bd538dbdaa4 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:14.983033 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.001004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.004957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff8ff-78fc-426b-9549-5bd538dbdaa4 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.008964 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89b948-1a4f-429b-af66-8843d4709dca None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.038218 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.039022 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.039307 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.039588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.041039 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.042375 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.042494 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.043033 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.043312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.043587 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.044132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 101/188] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.044359 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:15.044665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.046028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.049140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.058603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 88/189] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.058603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.145935 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ec84-3a2f-4b4e-8c77-aae49122b3e9 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.152797 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2a90-e15a-46e1-9050-8582584f24c0 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.179057 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.179849 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.180129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.180422 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.186051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.186906 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.187192 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.187475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.188688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.190151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.190255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:15.192426 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 89/190] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.193190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:15.198962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:15.200028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 102/191] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:15.200868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.209580 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.221312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.298673 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1519e3-2c0f-419f-9785-93839bd1a65e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.301815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3af09-6763-4fed-b979-a7f74ea58608 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.332628 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.333452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.333702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.333979 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.334543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.335216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.335506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.335828 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.336588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.338055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.344003 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:15.352295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:15.353256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:15.354028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 90/192] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:15.354679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.367803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 103/193] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:15 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:15.368678 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.439426 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.463437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.482528 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c7ccc-6e7e-4561-a475-92e783373bcd None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.484985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe479e-7a98-4add-b575-f9da87bb6e4e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.524298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.525095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.525384 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.525696 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.526538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=0d863b3bf1f7404a89e5e672973c4874) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:15.526829 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.527161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.528097 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.528327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.528419 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.528628 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] PATH_INFO: `/v3/users/9456094e1d2a4f91b506d0fbdee74cd5` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.535893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 104/194] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/role_assignments?user.id=0d863b3bf1f7404a89e5e672973c4874&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.536776 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.547125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] RBAC: Authorizing `identity:get_user(user_id=9456094e1d2a4f91b506d0fbdee74cd5)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.549086 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.551578 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 91/195] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/users/9456094e1d2a4f91b506d0fbdee74cd5 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.552227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.690118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98537634-4525-4f00-9003-e09cf0aab739 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.696434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287817c1-dd49-4788-8eeb-b7d72deeea9b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.732012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.736387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.737263 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.737706 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.738147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.739891 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:15.740233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.742004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.744874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.745652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.746035 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.746410 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.747263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:15.747672 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.749261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.751418 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 92/196] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.752855 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.757490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:15.761411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 105/197] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.762228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:15.875111 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506f508-1991-4b59-899a-7d0ec0676050 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.881528 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572af06-ee77-41b7-b766-e02c970b3bc8 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:15.916972 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.918767 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.919199 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.919642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.926866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:15.927904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:15.928298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:15.928748 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] PATH_INFO: `/v3/users/0090397446564209a6d867c03a901d05` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:15.930309 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] RBAC: Authorizing `identity:get_user(user_id=0090397446564209a6d867c03a901d05)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:15.932972 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:15.935548 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 106/198] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/users/0090397446564209a6d867c03a901d05 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:15.941095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.012649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.014524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.015923 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.018939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.079852 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323140-d9d1-4f75-81fb-2f79be44bf9c None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:16.125641 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:16.127166 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:16.127608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:16.128027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] PATH_INFO: `/v3/users/9456094e1d2a4f91b506d0fbdee74cd5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:16.130019 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] RBAC: Authorizing `identity:get_user(user_id=9456094e1d2a4f91b506d0fbdee74cd5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.131909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.134746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 107/199] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/users/9456094e1d2a4f91b506d0fbdee74cd5 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:16.136074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.144368 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 93/200] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:16.149130 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.250856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34ef3-a01a-4e3b-bd74-e113c0be72a2 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:16.276721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90b21-668c-4d39-8ade-12947def1516 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:16.279478 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.291008 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.303580 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:16.304907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:16.305541 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:16.305965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:16.317892 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:16.318691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:16.319050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:16.319403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:16.393026 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.395343 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.395591 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.397024 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.520820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 94/201] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:16.525123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.525905 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.538093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 108/202] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:16.543886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.570776 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.653815 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b12ea8-986b-467e-9436-6b8bdc55d674 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:16.658250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c425344-4c72-4ea8-97b7-88057f8e919c None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:16.689779 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:16.690867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:16.691256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:16.691701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:16.693034 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.694953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.701910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 95/203] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:16.701910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.702451 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:16.703632 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:16.704115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:16.704611 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:16.706134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.708478 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.710533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 109/204] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:16.711642 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.772953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.806872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcda1d3-891a-4b52-824f-3f112a604970 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:16.819058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:16.829822 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81d188-ff98-44cf-b1b0-4a9ec4a4706e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:16.844983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:16.845994 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:16.846287 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:16.846570 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:16.848641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.850155 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.852176 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 96/205] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:16.858241 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:16.873691 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:16.874747 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:16.875261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:16.875874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:16.877051 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=9456094e1d2a4f91b506d0fbdee74cd5) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:16.877700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:16.880119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:16.886562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 110/206] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/role_assignments?user.id=9456094e1d2a4f91b506d0fbdee74cd5&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:16.887630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:17.014935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e273b41-f4df-490d-ae69-9cfc3b36fe29 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:17.055090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53ecc-b9b7-404e-97c1-1a15e4689015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:17.055771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53ecc-b9b7-404e-97c1-1a15e4689015 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:17.056059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53ecc-b9b7-404e-97c1-1a15e4689015 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:17.056374 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53ecc-b9b7-404e-97c1-1a15e4689015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:17.057224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e53ecc-b9b7-404e-97c1-1a15e4689015 None admin] RBAC: Adding query filter params (role.id=db905eb62199424a865391fb08241ee4, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=9456094e1d2a4f91b506d0fbdee74cd5) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:17.057543 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e53ecc-b9b7-404e-97c1-1a15e4689015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:17.059761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e53ecc-b9b7-404e-97c1-1a15e4689015 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:17.066359 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 97/207] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/role_assignments?user.id=9456094e1d2a4f91b506d0fbdee74cd5&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=db905eb62199424a865391fb08241ee4 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:17.132484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867c9a-a9c6-412c-b7be-5d3bd64ecf12 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:17.190082 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67049a9-2fa8-453b-bda8-0eefe51ba17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:17.190778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67049a9-2fa8-453b-bda8-0eefe51ba17b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:17.191068 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67049a9-2fa8-453b-bda8-0eefe51ba17b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:17.191387 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67049a9-2fa8-453b-bda8-0eefe51ba17b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:17.192262 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67049a9-2fa8-453b-bda8-0eefe51ba17b None admin] RBAC: Adding query filter params (role.id=b2444542d70b4a3a9fcf9b6c5d0a7303, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b, user.id=0090397446564209a6d867c03a901d05) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:17.192589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67049a9-2fa8-453b-bda8-0eefe51ba17b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:17.194056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67049a9-2fa8-453b-bda8-0eefe51ba17b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:17.205214 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 111/208] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:16 2022] GET /identity/v3/role_assignments?user.id=0090397446564209a6d867c03a901d05&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:17.948872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e51f9-3d9d-4638-a2d7-77848131696f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:17.949247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e51f9-3d9d-4638-a2d7-77848131696f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:17.949452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e51f9-3d9d-4638-a2d7-77848131696f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:17.951032 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 98/209] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:17.956430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119113e-fbbf-4569-b35f-322400f2322c None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:17.956902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119113e-fbbf-4569-b35f-322400f2322c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:17.957604 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119113e-fbbf-4569-b35f-322400f2322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:17.978079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-e119113e-fbbf-4569-b35f-322400f2322c None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:17.979264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-e119113e-fbbf-4569-b35f-322400f2322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:17.995154 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:18.026030 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afacc35-e584-41ea-99fb-45d294751927 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.026535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afacc35-e584-41ea-99fb-45d294751927 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.026609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afacc35-e584-41ea-99fb-45d294751927 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.028170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 99/210] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:18.033146 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197df4a2-e594-4246-8a87-7fbe18f44e70 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.033435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197df4a2-e594-4246-8a87-7fbe18f44e70 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.033711 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197df4a2-e594-4246-8a87-7fbe18f44e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.040517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:18.052650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-197df4a2-e594-4246-8a87-7fbe18f44e70 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:18.054094 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-197df4a2-e594-4246-8a87-7fbe18f44e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:18.057097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 112/211] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:18.084530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119113e-fbbf-4569-b35f-322400f2322c None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:18.128224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 100/212] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:18.154061 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197df4a2-e594-4246-8a87-7fbe18f44e70 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:18.197159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119113e-fbbf-4569-b35f-322400f2322c None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:18.235843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:18.236907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.239522 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.240068 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.252052 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:18.265908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:18.267647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:18.269274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:18.271064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197df4a2-e594-4246-8a87-7fbe18f44e70 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:18.280250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 113/213] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:18.286447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:18.301515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:18.313101 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:18.314663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.315255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.315985 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.318128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:18.320479 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:18.323077 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 101/214] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:18.329122 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:18.332502 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:18.403586 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cbd0a-eacd-4a98-b1fa-48c63172997b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:18.439991 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47161dc-df5b-489d-ad42-1a5e193ec634 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:18.445893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:18.446851 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.447348 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.447822 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.449195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:18.449745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:18.452101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:18.462015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 114/215] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:18.467194 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:18.481319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:18.482433 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.483440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.484143 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.485259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:18.487399 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:18.516820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 102/216] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:18 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:49:18.557197 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:18.592523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddcbd4-b00a-4666-b613-7406bc1c70ca None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:18.629498 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:18.630396 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.630686 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.630967 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] PATH_INFO: `/v3/users/19bf47f9690d484a906748dd9e8a08fd` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.654706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=19bf47f9690d484a906748dd9e8a08fd)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:18.656610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:18.658942 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 115/217] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:18 2022] GET /identity/v3/users/19bf47f9690d484a906748dd9e8a08fd => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:18.664807 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:18.732132 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:18.778162 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8f481-a8d1-40c6-8abc-8eb98a8ad298 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:18.814336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:18.815047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:18.815436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:18.815676 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:18.888894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:18.890377 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:18.955895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:19.010956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 103/218] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:19.012336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:19.127148 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad199c0-f963-4022-ad01-7a718478a3f5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:19.159073 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:19.173050 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6f47c-4568-4547-a1b1-81168104e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:19.173976 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f47c-4568-4547-a1b1-81168104e953 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.174268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f47c-4568-4547-a1b1-81168104e953 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.174543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f47c-4568-4547-a1b1-81168104e953 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.175942 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6f47c-4568-4547-a1b1-81168104e953 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:19.177502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6f47c-4568-4547-a1b1-81168104e953 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:19.179574 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 116/219] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:19 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:19.186072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:19.324751 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7a09-b243-405b-88c1-ad1b565f2d19 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:19.353640 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9de7-2d37-438a-a8c6-6d9c4e186ac0 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.353952 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9de7-2d37-438a-a8c6-6d9c4e186ac0 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.354222 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9de7-2d37-438a-a8c6-6d9c4e186ac0 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.355605 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 117/220] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:19.360809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6de0-4d1b-41f5-8a39-00f28d3d6dfd None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.361102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6de0-4d1b-41f5-8a39-00f28d3d6dfd None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.361386 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6de0-4d1b-41f5-8a39-00f28d3d6dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.379423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-6d7d6de0-4d1b-41f5-8a39-00f28d3d6dfd None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:19.380594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-6d7d6de0-4d1b-41f5-8a39-00f28d3d6dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:19.387333 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:19.387999 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.388306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.388580 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.389414 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=19bf47f9690d484a906748dd9e8a08fd) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:19.389725 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:19.391157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:19.398738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 104/221] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:19 2022] GET /identity/v3/role_assignments?user.id=19bf47f9690d484a906748dd9e8a08fd&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=ae946283d08e403cba50982b7ee3d73a => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:19.486081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 118/222] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:19.522809 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:19.561017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:19.654230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b572259-d608-4892-aa28-086ef7e64c11 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:19.681612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0617-c064-473c-ab07-717f8f6bd4c0 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.681918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0617-c064-473c-ab07-717f8f6bd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.682186 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0617-c064-473c-ab07-717f8f6bd4c0 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.685266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 119/223] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:19.693998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20080f2a-c679-45dd-9c9b-2c122b8b971b None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.694144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20080f2a-c679-45dd-9c9b-2c122b8b971b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.694670 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20080f2a-c679-45dd-9c9b-2c122b8b971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.701285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:19.703117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.703788 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.707670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.724739 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-20080f2a-c679-45dd-9c9b-2c122b8b971b None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:19.726331 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-20080f2a-c679-45dd-9c9b-2c122b8b971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:19.733073 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:19.749402 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:19.750310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:19.751098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:19.754344 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 105/224] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:19.759797 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:19.856637 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 120/225] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:19.895816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:19.900435 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20080f2a-c679-45dd-9c9b-2c122b8b971b None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:19.937747 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706271e-37a6-42d8-8749-334230ac25d0 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:19.992135 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:19.992901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:19.993187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:19.993466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:19.994217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:19.994525 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:19.996501 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:20.006599 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 106/226] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:20.008746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:20.012039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:20.082492 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20080f2a-c679-45dd-9c9b-2c122b8b971b None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:20.115410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10624c4-ea42-4a7d-aa7f-35c75858739f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:20.147478 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:20.148504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:20.148722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:20.149141 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:20.149650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:20.150487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:20.150769 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:20.151041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] PATH_INFO: `/v3/users/9456094e1d2a4f91b506d0fbdee74cd5` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:20.152281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] RBAC: Authorizing `identity:get_user(user_id=9456094e1d2a4f91b506d0fbdee74cd5)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:20.153743 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:20.155688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 107/227] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:20 2022] GET /identity/v3/users/9456094e1d2a4f91b506d0fbdee74cd5 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:20.161536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:20.169986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:20.177671 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:20.186305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:20.187185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:20.188007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 121/228] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:20.195035 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:20.269602 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba1ecc-702c-4b25-8160-234f0933dda3 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:20.314929 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:20.315814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:20.316100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:20.316646 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:20.317912 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:20.319372 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:20.321122 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 108/229] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:20 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:20.326905 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:20.388764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c52e-4dda-4342-828d-38f94a61160d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:20.407345 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:20.430403 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:20.431092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:20.431382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:20.431663 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:20.432471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:20.432788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:20.434240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:20.457557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 122/230] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:20.466170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:20.468547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:20.487416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9218-ece0-48d9-8ae1-4a9fe87a3aac None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:20.558479 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:20.559876 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:20.560346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:20.560762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/9456094e1d2a4f91b506d0fbdee74cd5/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:20.563615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] RBAC: Authorizing `identity:create_grant(project_id=035e92addbe344c6af8d3e395fe4390f, user_id=9456094e1d2a4f91b506d0fbdee74cd5, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:20.565820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:20.592407 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 109/231] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:20 2022] PUT /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/9456094e1d2a4f91b506d0fbdee74cd5/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:49:20.620656 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610375cb-9117-4e09-8e09-3bd9183a3c83 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:20.659577 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:20.660709 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:20.661073 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:20.661424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] PATH_INFO: `/v3/users/9456094e1d2a4f91b506d0fbdee74cd5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:20.662697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] RBAC: Authorizing `identity:get_user(user_id=9456094e1d2a4f91b506d0fbdee74cd5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:20.664418 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:20.666788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 123/232] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:20 2022] GET /identity/v3/users/9456094e1d2a4f91b506d0fbdee74cd5 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:20.676516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:20.903685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913d9bc-898e-4c8d-a2df-4767962f302f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:20.946466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b71ee-1990-4bb6-ad7f-9f58fa961d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:20.947701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b71ee-1990-4bb6-ad7f-9f58fa961d98 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:20.948253 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b71ee-1990-4bb6-ad7f-9f58fa961d98 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:20.948803 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b71ee-1990-4bb6-ad7f-9f58fa961d98 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:20.950361 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b71ee-1990-4bb6-ad7f-9f58fa961d98 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:20.952000 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b71ee-1990-4bb6-ad7f-9f58fa961d98 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:20.954235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 110/233] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:20 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:20.967246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:21.052733 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:21.135155 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363d68-db8c-41f6-9554-b1dd381ef492 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:21.195602 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf29cf-e510-4c1f-9924-c1470ca95f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:21.196857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf29cf-e510-4c1f-9924-c1470ca95f64 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:21.197363 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf29cf-e510-4c1f-9924-c1470ca95f64 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:21.197852 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf29cf-e510-4c1f-9924-c1470ca95f64 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/9456094e1d2a4f91b506d0fbdee74cd5/roles/db905eb62199424a865391fb08241ee4` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:21.200289 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf29cf-e510-4c1f-9924-c1470ca95f64 None admin] RBAC: Authorizing `identity:create_grant(project_id=035e92addbe344c6af8d3e395fe4390f, user_id=9456094e1d2a4f91b506d0fbdee74cd5, role_id=db905eb62199424a865391fb08241ee4)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:21.201951 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf29cf-e510-4c1f-9924-c1470ca95f64 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:21.247703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 124/234] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:20 2022] PUT /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/9456094e1d2a4f91b506d0fbdee74cd5/roles/db905eb62199424a865391fb08241ee4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:21.806703 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05084ee-8b88-49fb-9831-3b914fe06ece None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:21.807221 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05084ee-8b88-49fb-9831-3b914fe06ece None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:21.807294 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05084ee-8b88-49fb-9831-3b914fe06ece None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:21.808887 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 111/235] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:21.815295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba56e-5e22-448c-98b4-7d8d3a795f16 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:21.815818 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba56e-5e22-448c-98b4-7d8d3a795f16 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:21.816379 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba56e-5e22-448c-98b4-7d8d3a795f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:21.834723 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-15aba56e-5e22-448c-98b4-7d8d3a795f16 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:21.836255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-15aba56e-5e22-448c-98b4-7d8d3a795f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:21.858860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3277ce6-75fb-4c8f-9506-fbb5beb2767d None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:21.859156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3277ce6-75fb-4c8f-9506-fbb5beb2767d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:21.859421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3277ce6-75fb-4c8f-9506-fbb5beb2767d None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:21.860824 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 112/236] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:21.867420 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714683b-474f-48f6-9909-a493c2679263 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:21.867716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714683b-474f-48f6-9909-a493c2679263 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:21.868001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714683b-474f-48f6-9909-a493c2679263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:21.901267 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-4714683b-474f-48f6-9909-a493c2679263 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:21.902481 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-4714683b-474f-48f6-9909-a493c2679263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:21.910075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:21.937996 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 125/237] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:21.975852 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aba56e-5e22-448c-98b4-7d8d3a795f16 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.049140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:22.061990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 113/238] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:22.092544 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aba56e-5e22-448c-98b4-7d8d3a795f16 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:22.096104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714683b-474f-48f6-9909-a493c2679263 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.139110 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2fae2-a3be-48c2-a931-4e7236d497e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:22.139920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2fae2-a3be-48c2-a931-4e7236d497e0 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.140233 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2fae2-a3be-48c2-a931-4e7236d497e0 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.140505 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2fae2-a3be-48c2-a931-4e7236d497e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.141764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2fae2-a3be-48c2-a931-4e7236d497e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:22.143360 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2fae2-a3be-48c2-a931-4e7236d497e0 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:22.145399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 126/239] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:22.146782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d067-e48a-446b-bfbc-3b5b5d3776dd None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.147113 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d067-e48a-446b-bfbc-3b5b5d3776dd None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.147549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d067-e48a-446b-bfbc-3b5b5d3776dd None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.149239 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 127/240] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:22.151819 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d067-e48a-446b-bfbc-3b5b5d3776dd None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.212366 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714683b-474f-48f6-9909-a493c2679263 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:22.255713 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60847cd6-eee3-453a-b0f3-030dff8ea9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:22.256611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847cd6-eee3-453a-b0f3-030dff8ea9ae None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.256901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847cd6-eee3-453a-b0f3-030dff8ea9ae None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.257181 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847cd6-eee3-453a-b0f3-030dff8ea9ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.270445 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:22.273943 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d067-e48a-446b-bfbc-3b5b5d3776dd None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:22.281516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60847cd6-eee3-453a-b0f3-030dff8ea9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-60847cd6-eee3-453a-b0f3-030dff8ea9ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:22.290962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:22.291883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:22.292716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:22.295232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 114/241] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:22.302056 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc03a0-3081-4fd3-8c3c-cd078ce08859 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.302620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc03a0-3081-4fd3-8c3c-cd078ce08859 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.303161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc03a0-3081-4fd3-8c3c-cd078ce08859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.311980 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:22.318287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:22.319615 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.320603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.320937 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.321703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:22.323390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:22.325547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-06dc03a0-3081-4fd3-8c3c-cd078ce08859 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:22.328067 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-06dc03a0-3081-4fd3-8c3c-cd078ce08859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:22.360223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 128/242] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:22 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:22.360223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.438630 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 115/243] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:22.469515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc03a0-3081-4fd3-8c3c-cd078ce08859 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.561145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef090c15-49fc-44fc-9627-7ca8a7c3f010 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:22.608035 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:22.608666 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.609435 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.609742 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.610503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:22.610811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:22.612783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:22.624455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 129/244] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:22.630614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.644017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc03a0-3081-4fd3-8c3c-cd078ce08859 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:22.670289 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:22.683061 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:22.694079 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:22.695215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.695720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.697419 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.713941 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:22.726922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:22.727837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:22.728693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:22.736440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 116/245] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:22.739004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.787593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad34c2f-fa4a-4261-8e68-1205fcf00790 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:22.838065 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:22.839411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.839902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.840432 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] PATH_INFO: `/v3/users/2734665e82c4454886a4bfd7679cc64e` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.857302 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] RBAC: Authorizing `identity:get_user(user_id=2734665e82c4454886a4bfd7679cc64e)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:22.859202 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:22.861915 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 130/246] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:22 2022] GET /identity/v3/users/2734665e82c4454886a4bfd7679cc64e => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:22.867488 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.872022 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175859-0bbd-495b-a317-f03f07edb65d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:22.907933 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:22.908645 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:22.908925 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:22.909241 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:22.910070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:22.910896 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:22.912312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:22.921357 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 117/247] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:22.927037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:22.977301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:23.000908 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:23.002536 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553ad1-46dc-4298-878f-81a6fb06e949 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:23.050309 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:23.051000 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:23.051283 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:23.051563 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:23.064842 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09864a-3d47-4467-8875-b6c000062438 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:23.109882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:23.111116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:23.111604 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:23.112102 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] PATH_INFO: `/v3/users/19bf47f9690d484a906748dd9e8a08fd` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:23.113593 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] RBAC: Authorizing `identity:get_user(user_id=19bf47f9690d484a906748dd9e8a08fd)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:23.115264 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:23.118280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 118/248] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:22 2022] GET /identity/v3/users/19bf47f9690d484a906748dd9e8a08fd => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:23.125679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:23.156310 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:23.159752 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:23.315113 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:23.319002 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92a6e-d244-47e5-b5f7-2d3c4a9470fb None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:23.351051 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 131/249] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:23.357462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:23.358565 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:23.400310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:23.401245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:23.401541 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:23.401816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:23.403469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:23.405101 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:23.407352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 119/250] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:23 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:23.414014 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:23.609074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b08805-9b55-4f7b-9f38-c8396539e282 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:23.642839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aab41-dc8a-4193-aa04-70c7421babc8 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:23.677209 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e15f0-b539-47d0-a740-26d11798f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:23.678012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e15f0-b539-47d0-a740-26d11798f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:23.678302 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e15f0-b539-47d0-a740-26d11798f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:23.678583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e15f0-b539-47d0-a740-26d11798f8f7 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:23.680845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e15f0-b539-47d0-a740-26d11798f8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:23.682327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e15f0-b539-47d0-a740-26d11798f8f7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:23.684053 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 132/251] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:23 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:23.686903 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014ad3e-0d7f-411d-b3d1-9ed71f03f6f6 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:23.687193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014ad3e-0d7f-411d-b3d1-9ed71f03f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:23.687466 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014ad3e-0d7f-411d-b3d1-9ed71f03f6f6 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:23.688761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 133/252] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:23.694961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014ad3e-0d7f-411d-b3d1-9ed71f03f6f6 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:23.702951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafe5b7-0a91-4da0-bdab-2fef1f01137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:23.703860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafe5b7-0a91-4da0-bdab-2fef1f01137b None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:23.704231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafe5b7-0a91-4da0-bdab-2fef1f01137b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:23.704524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafe5b7-0a91-4da0-bdab-2fef1f01137b None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/19bf47f9690d484a906748dd9e8a08fd/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:23.706627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafe5b7-0a91-4da0-bdab-2fef1f01137b None admin] RBAC: Authorizing `identity:create_grant(project_id=035e92addbe344c6af8d3e395fe4390f, user_id=19bf47f9690d484a906748dd9e8a08fd, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:23.708689 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafe5b7-0a91-4da0-bdab-2fef1f01137b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:23.725616 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 120/253] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:23 2022] PUT /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/19bf47f9690d484a906748dd9e8a08fd/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:23.727110 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d158f5d-31ba-445e-bba0-280ee941872c None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:23.727459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d158f5d-31ba-445e-bba0-280ee941872c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:23.727791 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d158f5d-31ba-445e-bba0-280ee941872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:23.747129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-0d158f5d-31ba-445e-bba0-280ee941872c None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:23.748422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-0d158f5d-31ba-445e-bba0-280ee941872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:23.802130 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:23.825418 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:23.834569 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 121/254] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:23.863788 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d158f5d-31ba-445e-bba0-280ee941872c None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:23.938249 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014ad3e-0d7f-411d-b3d1-9ed71f03f6f6 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:23.974317 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d158f5d-31ba-445e-bba0-280ee941872c None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:24.029125 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:24.029845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.030141 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.030437 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:24.031325 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] RBAC: Adding query filter params (role.id=b2444542d70b4a3a9fcf9b6c5d0a7303, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=2734665e82c4454886a4bfd7679cc64e) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:24.031646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:24.033207 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:24.038059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905823e1-ae74-49ae-8b56-283daafd26b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:24.039281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905823e1-ae74-49ae-8b56-283daafd26b8 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.040067 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905823e1-ae74-49ae-8b56-283daafd26b8 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.040583 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905823e1-ae74-49ae-8b56-283daafd26b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:24.043473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 134/255] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:23 2022] GET /identity/v3/role_assignments?user.id=2734665e82c4454886a4bfd7679cc64e&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:24.068464 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905823e1-ae74-49ae-8b56-283daafd26b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-905823e1-ae74-49ae-8b56-283daafd26b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:24.076474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:24.077427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:24.078222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 122/256] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:24.089419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:24.223908 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5437-4a03-4f8c-aaf5-9a5be168eefc None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.224224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5437-4a03-4f8c-aaf5-9a5be168eefc None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.224498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5437-4a03-4f8c-aaf5-9a5be168eefc None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:24.226049 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 123/257] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:24.231353 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eb257-bea1-48a6-8d40-524e335b30f6 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.231664 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eb257-bea1-48a6-8d40-524e335b30f6 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.232235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eb257-bea1-48a6-8d40-524e335b30f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:24.237419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91dad-eb2a-4c27-9f10-ceef03d38539 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:24.276272 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:24.285459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-3f5eb257-bea1-48a6-8d40-524e335b30f6 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:24.286702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-3f5eb257-bea1-48a6-8d40-524e335b30f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:24.309799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:24.310490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.310781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.311062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:24.311826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:24.312138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:24.313632 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:24.328493 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 135/258] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:24.337191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:24.340193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:24.389327 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 124/259] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 18:49:24.434156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5eb257-bea1-48a6-8d40-524e335b30f6 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:24.576002 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de681f-9930-4561-acf9-00e407b6c0a5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:24.676937 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:24.677830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.678113 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.678389 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] PATH_INFO: `/v3/users/9456094e1d2a4f91b506d0fbdee74cd5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:24.679623 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] RBAC: Authorizing `identity:get_user(user_id=9456094e1d2a4f91b506d0fbdee74cd5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:24.681120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:24.683071 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 136/260] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:24 2022] GET /identity/v3/users/9456094e1d2a4f91b506d0fbdee74cd5 => generated 283 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:24.688431 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:24.692179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5eb257-bea1-48a6-8d40-524e335b30f6 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:24.787041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:24.796931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:24.797763 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.798047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.798325 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:24.829277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:24.845607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:24.846624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:24.847416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 125/261] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:24.857120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:24.917098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22901-48cd-40da-b3da-74578fd159d6 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:24.934346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:24.987993 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:24.989208 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:24.989749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:24.990231 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:25.092549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:25.094553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:25.153079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:25.216875 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 137/262] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:25.223732 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:25.254175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6c247-a9b8-426f-af25-2eff14a41e51 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:25.337915 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f44bf-5859-4fc1-a2ff-f136614c4234 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:25.389005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:25.389610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:25.389896 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:25.390177 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:25.390487 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:25.390937 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:25.391248 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:25.391970 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:25.392488 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:25.392704 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:25.393170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:25.395474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:25.397215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:25.399466 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 138/263] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:25 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:25.405684 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:25.424529 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 126/264] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:25.428467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:25.433214 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:25.564716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70ede-6b2f-4057-9b0d-5539b31bbd78 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:25.629706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:25.630758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:25.631247 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:25.631726 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:25.632796 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=9456094e1d2a4f91b506d0fbdee74cd5) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:25.633342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:25.635001 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:25.641615 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 139/265] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:25 2022] GET /identity/v3/role_assignments?user.id=9456094e1d2a4f91b506d0fbdee74cd5&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:25.712632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:25.722029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef666d-658a-46a7-a48a-77ce54227172 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:25.776933 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368786-72a2-46ed-9450-e0d8f9cad733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:25.777930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368786-72a2-46ed-9450-e0d8f9cad733 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:25.778218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368786-72a2-46ed-9450-e0d8f9cad733 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:25.778498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368786-72a2-46ed-9450-e0d8f9cad733 None admin] PATH_INFO: `/v3/users/9456094e1d2a4f91b506d0fbdee74cd5` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:25.779770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368786-72a2-46ed-9450-e0d8f9cad733 None admin] RBAC: Authorizing `identity:get_user(user_id=9456094e1d2a4f91b506d0fbdee74cd5)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:25.781357 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368786-72a2-46ed-9450-e0d8f9cad733 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:25.783361 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 127/266] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:25 2022] GET /identity/v3/users/9456094e1d2a4f91b506d0fbdee74cd5 => generated 283 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:25.788929 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:25.934517 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:25.960300 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bd1fe-f60a-483b-8064-f93b15c45e0d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:25.992723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc8308-47be-4baf-b339-4359581ce55c None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:25.993162 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc8308-47be-4baf-b339-4359581ce55c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:25.993550 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc8308-47be-4baf-b339-4359581ce55c None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:25.995314 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 128/267] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:26.002622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727f331-e00e-45aa-8260-99d1879f7802 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.003019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727f331-e00e-45aa-8260-99d1879f7802 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.003404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727f331-e00e-45aa-8260-99d1879f7802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.007928 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:26.008788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.009204 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.009630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.049233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-f727f331-e00e-45aa-8260-99d1879f7802 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:26.050523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-f727f331-e00e-45aa-8260-99d1879f7802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:26.118506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:26.120115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:26.154137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 129/268] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:26.186425 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727f331-e00e-45aa-8260-99d1879f7802 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:26.287061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:26.332571 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:26.337080 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 140/269] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:26.340078 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:26.365401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727f331-e00e-45aa-8260-99d1879f7802 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:26.435274 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128625-7f1b-4d68-86e1-0ca1fb316eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:26.436083 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128625-7f1b-4d68-86e1-0ca1fb316eef None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.436392 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128625-7f1b-4d68-86e1-0ca1fb316eef None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.436716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128625-7f1b-4d68-86e1-0ca1fb316eef None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.449881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed128625-7f1b-4d68-86e1-0ca1fb316eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-ed128625-7f1b-4d68-86e1-0ca1fb316eef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:26.458898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:26.459848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:26.460663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:26.463170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 130/270] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:26.464875 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6b55-a66a-437c-951c-dd257607effe None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.465431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6b55-a66a-437c-951c-dd257607effe None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.465905 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6b55-a66a-437c-951c-dd257607effe None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.467469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 131/271] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:26.472590 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6b55-a66a-437c-951c-dd257607effe None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:26.484650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301b2e4-4399-4d7f-9b4c-3b248b6a2282 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:26.520907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180fb9f-52e9-479b-804e-43e58fb611be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:26.521779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180fb9f-52e9-479b-804e-43e58fb611be None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.522061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180fb9f-52e9-479b-804e-43e58fb611be None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.522336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180fb9f-52e9-479b-804e-43e58fb611be None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.523933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180fb9f-52e9-479b-804e-43e58fb611be None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:26.525814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180fb9f-52e9-479b-804e-43e58fb611be None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:26.528406 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 141/272] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:26 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:26.529600 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c37df-f950-42e6-859b-a68ea407d1e9 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.529883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c37df-f950-42e6-859b-a68ea407d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.530159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c37df-f950-42e6-859b-a68ea407d1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.552411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-6d5c37df-f950-42e6-859b-a68ea407d1e9 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:26.553968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-6d5c37df-f950-42e6-859b-a68ea407d1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:26.596244 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:26.601229 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6b55-a66a-437c-951c-dd257607effe None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:26.626161 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 142/273] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:26.627416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c37df-f950-42e6-859b-a68ea407d1e9 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:26.652776 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:26.653496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.653763 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.654058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.654888 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:26.655214 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:26.656617 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:26.672167 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 132/274] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:26.677502 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:26.692129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:26.738356 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c37df-f950-42e6-859b-a68ea407d1e9 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:26.781374 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:26.782424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.782933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.783408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.784555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] RBAC: Adding query filter params (role.id=db905eb62199424a865391fb08241ee4, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=9456094e1d2a4f91b506d0fbdee74cd5) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:26.785662 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:26.787453 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:26.794736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 143/275] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:26 2022] GET /identity/v3/role_assignments?user.id=9456094e1d2a4f91b506d0fbdee74cd5&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=db905eb62199424a865391fb08241ee4 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:26.796095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:26.801161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d6d42-c4bf-4519-8f76-c1fd783a6d39 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:26.841009 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:26.841872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:26.842916 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.843338 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.843766 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] PATH_INFO: `/v3/users/80cc7d3304044950bb1443534d860bdc` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.860643 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=80cc7d3304044950bb1443534d860bdc)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:26.862503 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:26.864770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 133/276] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:26 2022] GET /identity/v3/users/80cc7d3304044950bb1443534d860bdc => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:26.870389 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:26.947486 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6865e0-81ba-439c-b226-abae4979eabe None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:26.969954 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:26.989505 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0c32a-c230-4d66-8d03-91b1b6ee5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:26.990336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c32a-c230-4d66-8d03-91b1b6ee5b00 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.990694 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c32a-c230-4d66-8d03-91b1b6ee5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.991045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c32a-c230-4d66-8d03-91b1b6ee5b00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:26.992469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0c32a-c230-4d66-8d03-91b1b6ee5b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:26.994066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0c32a-c230-4d66-8d03-91b1b6ee5b00 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:26.995905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 144/277] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:26.997767 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd14f-ae93-4d80-8dc5-404a64dc5a19 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:26.998296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd14f-ae93-4d80-8dc5-404a64dc5a19 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:26.998848 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd14f-ae93-4d80-8dc5-404a64dc5a19 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.001153 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 145/278] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:27.006753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cd14f-ae93-4d80-8dc5-404a64dc5a19 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.023517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522e6d-16c3-47db-b4f2-f5a49b9c9fa8 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.060753 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6a7b3-9ef0-45e4-95c0-07738d686201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.061432 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a7b3-9ef0-45e4-95c0-07738d686201 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.061687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a7b3-9ef0-45e4-95c0-07738d686201 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.061967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a7b3-9ef0-45e4-95c0-07738d686201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.062869 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6a7b3-9ef0-45e4-95c0-07738d686201 None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, user.id=80cc7d3304044950bb1443534d860bdc, scope.system=all) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:27.063187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6a7b3-9ef0-45e4-95c0-07738d686201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:27.064697 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6a7b3-9ef0-45e4-95c0-07738d686201 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:27.074376 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 134/279] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Jul 14 18:49:26 2022] GET /identity/v3/role_assignments?user.id=80cc7d3304044950bb1443534d860bdc&scope.system=all&role.id=ae946283d08e403cba50982b7ee3d73a => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:27.075992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbd68d-9cdb-4416-9e77-a7564fd22c2b None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.075992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbd68d-9cdb-4416-9e77-a7564fd22c2b None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.075992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbd68d-9cdb-4416-9e77-a7564fd22c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.095952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-04fbd68d-9cdb-4416-9e77-a7564fd22c2b None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:27.097280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-04fbd68d-9cdb-4416-9e77-a7564fd22c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:27.136857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cd14f-ae93-4d80-8dc5-404a64dc5a19 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.153044 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:27.188014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.189016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.189452 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.189724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.190445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:27.192516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:27.203024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 135/280] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:27.203024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58b23-dcef-4006-9cc4-b7da4b71bbaf None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.203024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58b23-dcef-4006-9cc4-b7da4b71bbaf None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.203024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58b23-dcef-4006-9cc4-b7da4b71bbaf None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.203024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 136/281] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:27.205037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215498-e09e-4a45-a206-abd856f92f7d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.205037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215498-e09e-4a45-a206-abd856f92f7d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.205037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215498-e09e-4a45-a206-abd856f92f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.223125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-cc215498-e09e-4a45-a206-abd856f92f7d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:27.224398 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-cc215498-e09e-4a45-a206-abd856f92f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:27.225491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 146/282] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:27 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:27.227516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.305064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:27.320903 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 137/283] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:27.344095 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc215498-e09e-4a45-a206-abd856f92f7d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.355695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0c96c-865d-4e96-b23e-264cd2cbd9ca None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.398685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.399550 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.399841 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.400117 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.412411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:27.421719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:27.422614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:27.423397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 147/284] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:27.429195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.459470 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:27.480270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc215498-e09e-4a45-a206-abd856f92f7d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.524166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.525467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.526182 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.526681 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.538312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:27.546363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:27.547280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:27.548105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 138/285] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:27.556248 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.557138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8f78c-fae0-4a0c-b548-202b88bfda2d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.609557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.610237 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.610519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.610792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.611546 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:27.612542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:27.614633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:27.625754 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 148/286] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:27.631646 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:27.632933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.697914 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e822f1-a77c-4062-abeb-a7e3f30287e1 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.743976 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.744599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:27.744963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.745441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.745930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.747721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:27.748048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:27.750014 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:27.757360 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0311fe7-81ce-4d30-85cd-d912e226f12f None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.761094 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 139/287] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:27.766848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.801247 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.802191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.802478 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.802859 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] PATH_INFO: `/v3/users/19bf47f9690d484a906748dd9e8a08fd` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.804163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] RBAC: Authorizing `identity:get_user(user_id=19bf47f9690d484a906748dd9e8a08fd)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:27.805650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:27.807813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 149/288] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/users/19bf47f9690d484a906748dd9e8a08fd => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:27.813265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.876380 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62f791-f4ca-4846-b37f-3915f13c9304 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:27.892708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:27.915822 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:27.916894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:27.917286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:27.917670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] PATH_INFO: `/v3/users/2734665e82c4454886a4bfd7679cc64e` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:27.919004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=2734665e82c4454886a4bfd7679cc64e)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:27.920610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:27.922684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 140/289] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/users/2734665e82c4454886a4bfd7679cc64e => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:27.937584 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:27.976274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc0c3-ee35-4233-9a4d-4dfb917d6928 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:28.010413 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:28.011080 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:28.011437 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:28.011788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:28.034274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:28.083345 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:28.084983 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:28.138328 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521577-b98e-4770-b723-2e5db562b8e2 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:28.187559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 150/290] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:28.193866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:28.226343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:28.227287 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:28.227564 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:28.227833 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:28.230145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:28.231616 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:28.233547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 141/291] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:27 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:28.252911 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:28.296558 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:28.349902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:28.360658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c25d93-9bb8-4eb3-8518-db4814ae8d64 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:28.405690 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:28.406562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:28.406840 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:28.407109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:28.408324 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:28.409776 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:28.411503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 151/292] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:28 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:28.421409 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:28.465792 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7905-31b3-44c7-9e1d-b109eb69ead4 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:28.530442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f607f6-0e77-4fe2-8663-08fd5ab01fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:28.531247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f607f6-0e77-4fe2-8663-08fd5ab01fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:28.531524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f607f6-0e77-4fe2-8663-08fd5ab01fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:28.531796 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f607f6-0e77-4fe2-8663-08fd5ab01fb9 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/2734665e82c4454886a4bfd7679cc64e/roles/b2444542d70b4a3a9fcf9b6c5d0a7303` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:28.536601 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f607f6-0e77-4fe2-8663-08fd5ab01fb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=035e92addbe344c6af8d3e395fe4390f, user_id=2734665e82c4454886a4bfd7679cc64e, role_id=b2444542d70b4a3a9fcf9b6c5d0a7303)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:28.538067 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f607f6-0e77-4fe2-8663-08fd5ab01fb9 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:28.563696 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 142/293] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:49:28 2022] PUT /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f/users/2734665e82c4454886a4bfd7679cc64e/roles/b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:49:28.597107 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a336768-7a57-426f-ba3f-27dbdde5da67 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:28.620583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:28.636901 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6175c8-0942-4227-9242-b196a2347190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:28.637589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6175c8-0942-4227-9242-b196a2347190 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:28.637877 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6175c8-0942-4227-9242-b196a2347190 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:28.638158 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6175c8-0942-4227-9242-b196a2347190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:28.639017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6175c8-0942-4227-9242-b196a2347190 None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=19bf47f9690d484a906748dd9e8a08fd) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:28.639338 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6175c8-0942-4227-9242-b196a2347190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:28.640890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6175c8-0942-4227-9242-b196a2347190 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:28.648889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 152/294] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:28 2022] GET /identity/v3/role_assignments?user.id=19bf47f9690d484a906748dd9e8a08fd&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=ae946283d08e403cba50982b7ee3d73a => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:29.607596 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f252-b768-43b5-bb65-86dee017351d None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:29.608248 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f252-b768-43b5-bb65-86dee017351d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:29.608248 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f252-b768-43b5-bb65-86dee017351d None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:29.609949 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 143/295] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:29.615400 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c952-5e2e-40a6-ab8a-39971798bf11 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:29.615889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c952-5e2e-40a6-ab8a-39971798bf11 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:29.616042 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c952-5e2e-40a6-ab8a-39971798bf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:29.633754 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-64b4c952-5e2e-40a6-ab8a-39971798bf11 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:29.634941 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-64b4c952-5e2e-40a6-ab8a-39971798bf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:29.702865 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 153/296] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:29.727226 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347f252-b768-43b5-bb65-86dee017351d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:29.840413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347f252-b768-43b5-bb65-86dee017351d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:29.850475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:29.881835 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f3ac-f75f-43f4-a83e-f1966b57a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:29.882552 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f3ac-f75f-43f4-a83e-f1966b57a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:29.882829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f3ac-f75f-43f4-a83e-f1966b57a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:29.883102 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f3ac-f75f-43f4-a83e-f1966b57a0d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:29.893765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f3ac-f75f-43f4-a83e-f1966b57a0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-50d1f3ac-f75f-43f4-a83e-f1966b57a0d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:29.902204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:29.904352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:29.906574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:29.908047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ce69a-7b53-42e5-8c2b-5766b89521f2 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:29.908047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ce69a-7b53-42e5-8c2b-5766b89521f2 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:29.908047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ce69a-7b53-42e5-8c2b-5766b89521f2 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:29.908047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 154/298] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:29.909442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 144/298] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:29.909573 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ce69a-7b53-42e5-8c2b-5766b89521f2 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:29.911064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92565d5-9faa-456f-ac24-365f03dfc57f None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:29.911489 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92565d5-9faa-456f-ac24-365f03dfc57f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:29.911912 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92565d5-9faa-456f-ac24-365f03dfc57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:29.930814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-a92565d5-9faa-456f-ac24-365f03dfc57f None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:29.932193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-a92565d5-9faa-456f-ac24-365f03dfc57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:30.004272 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 145/299] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:30.025083 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ce69a-7b53-42e5-8c2b-5766b89521f2 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.029540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92565d5-9faa-456f-ac24-365f03dfc57f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.042346 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:30.065051 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.065736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.066028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.066845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.067601 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:30.067914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.069338 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.078522 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 155/300] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:30.085164 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.151342 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:30.158021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92565d5-9faa-456f-ac24-365f03dfc57f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.194675 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fd2a0-2746-4af3-84e1-2e2c7eaddc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.195786 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd2a0-2746-4af3-84e1-2e2c7eaddc54 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.196273 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd2a0-2746-4af3-84e1-2e2c7eaddc54 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.196696 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd2a0-2746-4af3-84e1-2e2c7eaddc54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.205930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a524-2b3f-43d7-a0bd-4ba8e1c35bfa None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.207374 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fd2a0-2746-4af3-84e1-2e2c7eaddc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f67fd2a0-2746-4af3-84e1-2e2c7eaddc54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:30.215469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:30.216533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:30.217516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:30.219575 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 146/301] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:30.221034 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0777eb-388c-441d-8264-d2ac4e731419 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.221458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0777eb-388c-441d-8264-d2ac4e731419 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.221894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0777eb-388c-441d-8264-d2ac4e731419 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.223304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 147/302] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:30.225240 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0777eb-388c-441d-8264-d2ac4e731419 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.247083 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6600cc-3317-4f6b-aa4a-af7dc3df0987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.247959 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6600cc-3317-4f6b-aa4a-af7dc3df0987 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.248540 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6600cc-3317-4f6b-aa4a-af7dc3df0987 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.248540 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6600cc-3317-4f6b-aa4a-af7dc3df0987 None admin] PATH_INFO: `/v3/users/80cc7d3304044950bb1443534d860bdc` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.249753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6600cc-3317-4f6b-aa4a-af7dc3df0987 None admin] RBAC: Authorizing `identity:get_user(user_id=80cc7d3304044950bb1443534d860bdc)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.251204 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6600cc-3317-4f6b-aa4a-af7dc3df0987 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.257788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 156/303] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:30 2022] GET /identity/v3/users/80cc7d3304044950bb1443534d860bdc => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:30.257788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a948e7-5ec6-4f2c-81d3-e09bd10a939e None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.257788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a948e7-5ec6-4f2c-81d3-e09bd10a939e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.257788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a948e7-5ec6-4f2c-81d3-e09bd10a939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.276757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-d0a948e7-5ec6-4f2c-81d3-e09bd10a939e None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:30.278042 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-d0a948e7-5ec6-4f2c-81d3-e09bd10a939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:30.322600 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:30.345593 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0777eb-388c-441d-8264-d2ac4e731419 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.351878 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 157/304] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:30.361738 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a948e7-5ec6-4f2c-81d3-e09bd10a939e None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.382542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.383548 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.384035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.384512 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.385624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:30.386113 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.387679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.401671 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 148/305] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:30.402306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.425655 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:30.471132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a948e7-5ec6-4f2c-81d3-e09bd10a939e None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.509748 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865502-72bd-4b47-b073-e4030626e175 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.513501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.514535 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.514869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.515091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] PATH_INFO: `/v3/system/users/80cc7d3304044950bb1443534d860bdc/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.516980 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=80cc7d3304044950bb1443534d860bdc, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.518970 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.530289 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 158/306] 10.222.0.72 () {58 vars in 1334 bytes} [Thu Jul 14 18:49:30 2022] PUT /identity/v3/system/users/80cc7d3304044950bb1443534d860bdc/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:30.531252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.566860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.568719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.569007 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.569283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] PATH_INFO: `/v3/domains/default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.571242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.572775 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.579761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 149/307] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:30.585234 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.590823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:30.665699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155f4a0-58df-4164-a569-acee6456e4c7 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.710098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.710988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.711271 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.711554 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] PATH_INFO: `/v3/users/19189a0616d8475d804d018dae623de5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.726599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] RBAC: Authorizing `identity:get_user(user_id=19189a0616d8475d804d018dae623de5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.727092 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:30.728153 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.730062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 159/308] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:30 2022] GET /identity/v3/users/19189a0616d8475d804d018dae623de5 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:30.736218 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:30.744329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd589-10b7-4187-82a7-2f46085f1852 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.788157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45434473-187e-43e0-aaf5-eda1acb9f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.789338 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45434473-187e-43e0-aaf5-eda1acb9f6de None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.789760 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45434473-187e-43e0-aaf5-eda1acb9f6de None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.790422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45434473-187e-43e0-aaf5-eda1acb9f6de None admin] PATH_INFO: `/v3/groups` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.791121 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45434473-187e-43e0-aaf5-eda1acb9f6de None admin] RBAC: Authorizing `identity:create_group()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.793228 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45434473-187e-43e0-aaf5-eda1acb9f6de None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.812357 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 150/309] 10.222.0.72 () {60 vars in 1134 bytes} [Thu Jul 14 18:49:30 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:49:30.852468 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:30.861574 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbbb7a-5a77-4005-80f1-6c86c85a8f29 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:30.903685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73260e81-16c4-4173-94b4-5d3b822e1ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:30.904403 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260e81-16c4-4173-94b4-5d3b822e1ed4 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:30.904744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260e81-16c4-4173-94b4-5d3b822e1ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:30.905028 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260e81-16c4-4173-94b4-5d3b822e1ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:30.905944 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73260e81-16c4-4173-94b4-5d3b822e1ed4 None admin] RBAC: Adding query filter params (role.id=b2444542d70b4a3a9fcf9b6c5d0a7303, user.id=19189a0616d8475d804d018dae623de5, scope.system=all) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:30.906258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73260e81-16c4-4173-94b4-5d3b822e1ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:30.907875 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73260e81-16c4-4173-94b4-5d3b822e1ed4 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:30.914557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 160/310] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Jul 14 18:49:30 2022] GET /identity/v3/role_assignments?user.id=19189a0616d8475d804d018dae623de5&scope.system=all&role.id=b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:31.002827 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfa97e-ddfe-4968-8493-15c8fe4473f2 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:31.003040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfa97e-ddfe-4968-8493-15c8fe4473f2 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:31.003286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfa97e-ddfe-4968-8493-15c8fe4473f2 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:31.005712 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 151/311] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:31.011201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d01bb-ee7a-4789-969b-b62d80e1075c None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:31.011509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d01bb-ee7a-4789-969b-b62d80e1075c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:31.011776 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d01bb-ee7a-4789-969b-b62d80e1075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:31.032495 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-8a4d01bb-ee7a-4789-969b-b62d80e1075c None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:31.033724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-8a4d01bb-ee7a-4789-969b-b62d80e1075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:31.110542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 161/312] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:31.135756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfa97e-ddfe-4968-8493-15c8fe4473f2 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:31.248697 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfa97e-ddfe-4968-8493-15c8fe4473f2 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:31.285562 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:31.286370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:31.286653 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:31.286927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:31.297953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:31.305840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:31.306719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:31.307496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 152/313] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:31.312849 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d01bb-ee7a-4789-969b-b62d80e1075c None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:31.408596 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:31.422779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d01bb-ee7a-4789-969b-b62d80e1075c None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:31.458994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:31.460030 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:31.460539 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:31.461014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:31.461991 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:31.462494 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:31.464064 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:31.473141 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 162/314] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:31.480231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:31.506099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:31.589115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207927-4aa7-4621-a432-2a1d07f14047 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:31.622701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:31.623567 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:31.623849 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:31.624122 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] PATH_INFO: `/v3/users/2734665e82c4454886a4bfd7679cc64e` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:31.625350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] RBAC: Authorizing `identity:get_user(user_id=2734665e82c4454886a4bfd7679cc64e)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:31.626790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:31.629303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 153/315] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:31 2022] GET /identity/v3/users/2734665e82c4454886a4bfd7679cc64e => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:31.637292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:31.747265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d078cc-f893-4507-95e5-a68313893b06 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:31.782042 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:31.782720 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:31.783005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:31.783282 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:31.808608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:31.854839 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:31.856265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:31.958104 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 163/316] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:31.963506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:32.045027 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:32.068901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1661-e69e-4462-b41a-4be4b084a808 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:32.108873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebedee-b4cc-4db3-82c5-9b958c9ab561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:32.109673 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebedee-b4cc-4db3-82c5-9b958c9ab561 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:32.109953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebedee-b4cc-4db3-82c5-9b958c9ab561 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:32.110228 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebedee-b4cc-4db3-82c5-9b958c9ab561 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:32.111511 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebedee-b4cc-4db3-82c5-9b958c9ab561 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:32.113013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebedee-b4cc-4db3-82c5-9b958c9ab561 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:32.115694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 154/317] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:31 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:32.121530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:32.176815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:32.226148 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f8ea0-e5ec-461b-abcd-6a194e24efe1 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:32.261416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1756f27-60d0-42dd-bd36-ac91d611dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:32.262074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756f27-60d0-42dd-bd36-ac91d611dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:32.262359 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756f27-60d0-42dd-bd36-ac91d611dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:32.262635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756f27-60d0-42dd-bd36-ac91d611dcb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:32.263467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1756f27-60d0-42dd-bd36-ac91d611dcb7 None admin] RBAC: Adding query filter params (role.id=b2444542d70b4a3a9fcf9b6c5d0a7303, scope.project.id=035e92addbe344c6af8d3e395fe4390f, user.id=2734665e82c4454886a4bfd7679cc64e) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:32.263779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1756f27-60d0-42dd-bd36-ac91d611dcb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:32.265256 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1756f27-60d0-42dd-bd36-ac91d611dcb7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:32.271725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 164/318] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:32 2022] GET /identity/v3/role_assignments?user.id=2734665e82c4454886a4bfd7679cc64e&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:32.924234 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88054a-3f09-493f-b5ea-ec0bd932de45 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:32.924614 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88054a-3f09-493f-b5ea-ec0bd932de45 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:32.924819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88054a-3f09-493f-b5ea-ec0bd932de45 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:32.926337 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 155/319] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:32.931336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d1317-d14b-4a26-8b90-66a61aab7f46 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:32.931774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d1317-d14b-4a26-8b90-66a61aab7f46 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:32.931954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d1317-d14b-4a26-8b90-66a61aab7f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:32.949099 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-ba0d1317-d14b-4a26-8b90-66a61aab7f46 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:32.950297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-ba0d1317-d14b-4a26-8b90-66a61aab7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:33.016464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 165/320] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:33.042513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88054a-3f09-493f-b5ea-ec0bd932de45 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.152618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88054a-3f09-493f-b5ea-ec0bd932de45 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.187321 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480e9e0-8df7-4276-924d-4ceb2637222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.188036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e9e0-8df7-4276-924d-4ceb2637222e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.188349 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e9e0-8df7-4276-924d-4ceb2637222e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.188625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e9e0-8df7-4276-924d-4ceb2637222e None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.199373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480e9e0-8df7-4276-924d-4ceb2637222e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-4480e9e0-8df7-4276-924d-4ceb2637222e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:33.207200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:33.208071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:33.209242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:33.212347 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 156/321] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:33.214225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d1317-d14b-4a26-8b90-66a61aab7f46 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.215509 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d53b8-43c6-4956-a081-47d4063aa0f6 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.215805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d53b8-43c6-4956-a081-47d4063aa0f6 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.216090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d53b8-43c6-4956-a081-47d4063aa0f6 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.217591 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 157/322] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:33.221278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f788a7-cda5-4272-ac5a-00093c9a37fe None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.221569 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f788a7-cda5-4272-ac5a-00093c9a37fe None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.221846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f788a7-cda5-4272-ac5a-00093c9a37fe None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.223123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 158/323] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:33.225250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b41b22-9294-4005-ba78-a2c66083288c None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.225539 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b41b22-9294-4005-ba78-a2c66083288c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.225818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b41b22-9294-4005-ba78-a2c66083288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.231615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:33.244592 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-39b41b22-9294-4005-ba78-a2c66083288c None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:33.245784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-39b41b22-9294-4005-ba78-a2c66083288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:33.266854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:33.314129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 159/324] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:33.317216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e0a59-15a7-4d49-97da-f695c69f5458 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.317216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e0a59-15a7-4d49-97da-f695c69f5458 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.317216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e0a59-15a7-4d49-97da-f695c69f5458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.322545 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d1317-d14b-4a26-8b90-66a61aab7f46 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.335018 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-9b6e0a59-15a7-4d49-97da-f695c69f5458 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:33.336194 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-9b6e0a59-15a7-4d49-97da-f695c69f5458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:33.357498 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.358173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.358457 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.358728 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.359477 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:33.359779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:33.361175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:33.369599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 166/325] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:33.369599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.403283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 160/326] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:33.404124 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e0a59-15a7-4d49-97da-f695c69f5458 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.465846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:33.475517 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25f50-2bbb-4e48-ba9d-d1374a6919c5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.484450 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:33.507969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e0a59-15a7-4d49-97da-f695c69f5458 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.510217 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.511015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.511304 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.511586 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.521599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:33.529405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:33.530263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:33.531045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 167/327] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:33.531698 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.546034 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.546906 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.547195 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.547478 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] PATH_INFO: `/v3/users/80cc7d3304044950bb1443534d860bdc` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.548697 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] RBAC: Authorizing `identity:get_user(user_id=80cc7d3304044950bb1443534d860bdc)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:33.550156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:33.552424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 161/328] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/users/80cc7d3304044950bb1443534d860bdc => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:33.553175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.635338 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c0f7c-e137-4560-a775-456628281831 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.649695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d042c-8e13-42e2-81e8-f8b612fce10d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.668975 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.669764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.670050 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.670330 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] PATH_INFO: `/v3/domains/default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.671500 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:33.672982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:33.674743 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 168/329] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:33.676404 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.680918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:33.686161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.686929 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.687222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.687502 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.688289 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:33.688601 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:33.689984 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:33.698373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 162/330] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:33.699134 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.716534 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:33.780846 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da213d-f6e2-4ee6-920c-81226ca6a15b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.798501 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a75de-af7d-4201-ab47-1979d7945eaa None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:33.814295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.814946 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.815228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.815501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.816382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] RBAC: Adding query filter params (role.id=ae946283d08e403cba50982b7ee3d73a, user.id=80cc7d3304044950bb1443534d860bdc, scope.system=all) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:33.816693 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:33.818132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:33.829260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 169/331] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/role_assignments?user.id=80cc7d3304044950bb1443534d860bdc&scope.system=all&role.id=ae946283d08e403cba50982b7ee3d73a => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:33.830040 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:33.845643 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:33.846341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:33.846628 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:33.846909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] PATH_INFO: `/v3/groups` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:33.848143 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:33.849720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:33.868538 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 163/332] 10.222.0.72 () {60 vars in 1134 bytes} [Thu Jul 14 18:49:33 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:33.958937 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:33.968324 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21625797-bba9-45c0-ad54-3f17a2d7a347 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:34.007602 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780e161-0730-4de7-a4a8-db23cc64eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:34.008564 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780e161-0730-4de7-a4a8-db23cc64eb2b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:34.008853 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780e161-0730-4de7-a4a8-db23cc64eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:34.009131 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780e161-0730-4de7-a4a8-db23cc64eb2b None admin] PATH_INFO: `/v3/users/19189a0616d8475d804d018dae623de5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:34.010458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780e161-0730-4de7-a4a8-db23cc64eb2b None admin] RBAC: Authorizing `identity:get_user(user_id=19189a0616d8475d804d018dae623de5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:34.011962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780e161-0730-4de7-a4a8-db23cc64eb2b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:34.014105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 170/333] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:33 2022] GET /identity/v3/users/19189a0616d8475d804d018dae623de5 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:34.020219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:34.087506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:34.134041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954b0d-f1b9-46b0-99de-f8dd806ba780 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:34.169519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb8920-e61b-4c37-bbbf-94c87a7f8ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:34.170392 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb8920-e61b-4c37-bbbf-94c87a7f8ce2 None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:34.170685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb8920-e61b-4c37-bbbf-94c87a7f8ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:34.170966 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb8920-e61b-4c37-bbbf-94c87a7f8ce2 None admin] PATH_INFO: `/v3/system/users/19189a0616d8475d804d018dae623de5/roles/b2444542d70b4a3a9fcf9b6c5d0a7303` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:34.172501 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb8920-e61b-4c37-bbbf-94c87a7f8ce2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=19189a0616d8475d804d018dae623de5, role_id=b2444542d70b4a3a9fcf9b6c5d0a7303)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:34.173898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb8920-e61b-4c37-bbbf-94c87a7f8ce2 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:34.182349 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 164/334] 10.222.0.72 () {58 vars in 1334 bytes} [Thu Jul 14 18:49:34 2022] PUT /identity/v3/system/users/19189a0616d8475d804d018dae623de5/roles/b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:36.374464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859152-e9bd-4858-88c2-0c4d3ee0b96f None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:36.375059 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859152-e9bd-4858-88c2-0c4d3ee0b96f None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:36.375059 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859152-e9bd-4858-88c2-0c4d3ee0b96f None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:36.376430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 171/335] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:36.383319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc5c-c413-45f3-be69-dff81061836a None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:36.384159 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc5c-c413-45f3-be69-dff81061836a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:36.384633 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc5c-c413-45f3-be69-dff81061836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:36.413236 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-35dfbc5c-c413-45f3-be69-dff81061836a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:36.414696 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-35dfbc5c-c413-45f3-be69-dff81061836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:36.503754 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 165/336] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:36.545844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859152-e9bd-4858-88c2-0c4d3ee0b96f None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:36.663714 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859152-e9bd-4858-88c2-0c4d3ee0b96f None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:36.703940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ef051-e814-453a-b553-45492f76e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:36.705032 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ef051-e814-453a-b553-45492f76e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:36.705485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ef051-e814-453a-b553-45492f76e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:36.705927 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ef051-e814-453a-b553-45492f76e4b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:36.729893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ef051-e814-453a-b553-45492f76e4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-ba4ef051-e814-453a-b553-45492f76e4b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:36.738721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:36.739883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:36.745018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:36.747491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 172/337] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:36.753178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfbc5c-c413-45f3-be69-dff81061836a None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:36.778788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf9065-3572-43c4-b824-4b2e5960af63 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:36.779410 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf9065-3572-43c4-b824-4b2e5960af63 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:36.779857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf9065-3572-43c4-b824-4b2e5960af63 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:36.781686 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 173/338] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:36.790075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc7262-596a-4fb9-98dc-f4c1c3a57b99 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:36.790851 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc7262-596a-4fb9-98dc-f4c1c3a57b99 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:36.791442 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc7262-596a-4fb9-98dc-f4c1c3a57b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:36.816135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-53cc7262-596a-4fb9-98dc-f4c1c3a57b99 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:36.817654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-53cc7262-596a-4fb9-98dc-f4c1c3a57b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:36.833864 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:36.842816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:36.926025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfbc5c-c413-45f3-be69-dff81061836a None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:36.930581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 174/339] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:36.975358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:36.976040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:36.976355 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:36.976635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:36.977401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:36.977700 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:36.979074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:36.980638 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc7262-596a-4fb9-98dc-f4c1c3a57b99 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:36.994517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 166/340] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:36.994517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:37.143877 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc7262-596a-4fb9-98dc-f4c1c3a57b99 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:37.151662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1670f0-edb0-41d2-b727-7bec321b9651 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:37.177832 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:37.208937 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:37.210131 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.210640 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.211128 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.216970 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51b6e9-7a6d-42dc-b141-4a6639ee9791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:37.217642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b6e9-7a6d-42dc-b141-4a6639ee9791 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.217932 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b6e9-7a6d-42dc-b141-4a6639ee9791 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.218240 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b6e9-7a6d-42dc-b141-4a6639ee9791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.229674 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:37.246195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:37.247144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 18:49:37.247948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:37.250462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 175/341] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:37.256519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:37.292719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:37.319537 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51b6e9-7a6d-42dc-b141-4a6639ee9791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:37.321174 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51b6e9-7a6d-42dc-b141-4a6639ee9791 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:37.395453 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cce6d-e046-4845-b618-937ddd2bef78 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:37.442836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:37.443887 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.444366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.444876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.445493 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 167/342] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:37.447386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c111-a1b8-4e60-8e6d-eb64de798834 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.447885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c111-a1b8-4e60-8e6d-eb64de798834 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.448407 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c111-a1b8-4e60-8e6d-eb64de798834 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.449598 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:37.449980 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:37.450597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 168/343] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:37.451434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:37.452088 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0161-736b-4ba3-9061-922738d7e856 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.452603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0161-736b-4ba3-9061-922738d7e856 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.453091 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0161-736b-4ba3-9061-922738d7e856 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.454717 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 169/344] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:37.462463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea9f4-55a7-42ce-be5c-694f58bf0d98 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.463004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea9f4-55a7-42ce-be5c-694f58bf0d98 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.463517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea9f4-55a7-42ce-be5c-694f58bf0d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.470490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 176/345] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:37.472836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:37.492853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-3daea9f4-55a7-42ce-be5c-694f58bf0d98 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:37.494338 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-3daea9f4-55a7-42ce-be5c-694f58bf0d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:37.499693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:37.577939 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:37.591694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 170/346] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:37.593573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51291-e92f-47c7-b296-b51f6847adcd None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.594026 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51291-e92f-47c7-b296-b51f6847adcd None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.594509 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a51291-e92f-47c7-b296-b51f6847adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.613215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77b91-839f-4488-bf63-68f32d74a6e3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:37.615724 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-d4a51291-e92f-47c7-b296-b51f6847adcd None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:37.617144 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-d4a51291-e92f-47c7-b296-b51f6847adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:37.667850 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:37.669201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.669497 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.669782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.671523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:37.673328 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:37.676689 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 177/347] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:37 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:37.677749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:37.706974 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 171/348] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:37.707897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a51291-e92f-47c7-b296-b51f6847adcd None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:37.801245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998d75-1464-4f2c-8f34-f5d70a9d41f3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:37.805491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:37.839810 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a51291-e92f-47c7-b296-b51f6847adcd None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:37.848020 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:37.848967 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.849603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.849891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] PATH_INFO: `/v3/users/19189a0616d8475d804d018dae623de5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.851145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] RBAC: Authorizing `identity:get_user(user_id=19189a0616d8475d804d018dae623de5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:37.853071 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:37.860095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 178/349] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Jul 14 18:49:37 2022] GET /identity/v3/users/19189a0616d8475d804d018dae623de5 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:37.860095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:37.875377 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:37.887250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:37.888471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:37.888777 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:37.889058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:37.904444 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:37.916037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:37.917296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 172/350] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:37.919005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:37.997095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14135c4-1d47-4bad-a7ea-92b42ddb22a6 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.049924 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.052824 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.053211 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.053592 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.060750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:38.062580 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:38.064412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c598e-8160-4a7a-924e-8b92fb1d5294 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.066791 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 179/351] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:37 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:38.066981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:38.102938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:38.111114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.112391 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.112945 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.113793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.125907 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:38.135521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:38.136784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 173/352] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:38.137585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:38.167089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:38.202482 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cf176-bdcc-44de-9994-5cde4e0bb5cb None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.246172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.247228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.247764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.248298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.249327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] RBAC: Adding query filter params (role.id=b2444542d70b4a3a9fcf9b6c5d0a7303, user.id=19189a0616d8475d804d018dae623de5, scope.system=all) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:38.249836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:38.251484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:38.274018 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154240a-bb9b-4201-953d-f4a483b74476 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.274441 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 180/353] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Jul 14 18:49:38 2022] GET /identity/v3/role_assignments?user.id=19189a0616d8475d804d018dae623de5&scope.system=all&role.id=b2444542d70b4a3a9fcf9b6c5d0a7303 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:38.275590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:38.323451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.324838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.325141 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.325428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.326227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:38.326724 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:38.328419 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:38.340005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 174/354] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:38.345996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:38.416853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:38.479520 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05027b-bd57-4cb1-849c-daf94f8b10aa None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.483783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869974aa-66d5-41dc-a8d8-34a5a73370d3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.526029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.527607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.528177 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.528656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.529840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:38.530700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:38.532139 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:38.534035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:38.538382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc942f-3f9e-4286-8724-34bbfc5503f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.539612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc942f-3f9e-4286-8724-34bbfc5503f7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.539998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc942f-3f9e-4286-8724-34bbfc5503f7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.540688 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc942f-3f9e-4286-8724-34bbfc5503f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.541652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc942f-3f9e-4286-8724-34bbfc5503f7 None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:38.542071 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc942f-3f9e-4286-8724-34bbfc5503f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:38.544237 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc942f-3f9e-4286-8724-34bbfc5503f7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:38.547207 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 175/355] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:38.548317 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:38.562140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 181/356] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:38 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=ae946283d08e403cba50982b7ee3d73a => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:38.563571 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd72cf-ab03-4040-aa62-0c53d2079eed None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.563960 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd72cf-ab03-4040-aa62-0c53d2079eed None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.564503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd72cf-ab03-4040-aa62-0c53d2079eed None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.572252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 182/357] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:38.572252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd72cf-ab03-4040-aa62-0c53d2079eed None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:38.729188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186de5-81a2-4264-928b-6dd1407260d4 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.739364 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd72cf-ab03-4040-aa62-0c53d2079eed None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:38.747538 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:38.775537 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12babffc-5eb2-4ba6-ae78-b7a4d5a15571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.776375 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babffc-5eb2-4ba6-ae78-b7a4d5a15571 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.776739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babffc-5eb2-4ba6-ae78-b7a4d5a15571 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.777091 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12babffc-5eb2-4ba6-ae78-b7a4d5a15571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.794363 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103ec25-0fcb-4b94-afad-c79ffaa64e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:38.795139 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103ec25-0fcb-4b94-afad-c79ffaa64e65 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.795521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103ec25-0fcb-4b94-afad-c79ffaa64e65 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.796516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103ec25-0fcb-4b94-afad-c79ffaa64e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:38.862285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12babffc-5eb2-4ba6-ae78-b7a4d5a15571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:38.863917 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12babffc-5eb2-4ba6-ae78-b7a4d5a15571 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:38.893456 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:38.903411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103ec25-0fcb-4b94-afad-c79ffaa64e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:38.905513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103ec25-0fcb-4b94-afad-c79ffaa64e65 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:38.990794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 176/358] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:38.992020 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd577a5e-0a92-4767-8957-5c5127e7da79 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:38.993395 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd577a5e-0a92-4767-8957-5c5127e7da79 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:38.993395 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd577a5e-0a92-4767-8957-5c5127e7da79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.015112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-cd577a5e-0a92-4767-8957-5c5127e7da79 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:39.016413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-cd577a5e-0a92-4767-8957-5c5127e7da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:39.027024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:39.045363 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 183/359] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:39.050463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcafc7-e98e-4b0e-bb18-01527eef6643 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.050463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcafc7-e98e-4b0e-bb18-01527eef6643 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.050463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcafc7-e98e-4b0e-bb18-01527eef6643 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.050463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 184/360] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:39.050463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcafc7-e98e-4b0e-bb18-01527eef6643 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.105111 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 177/361] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:39.107869 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd577a5e-0a92-4767-8957-5c5127e7da79 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.183567 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:39.196060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcafc7-e98e-4b0e-bb18-01527eef6643 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.231241 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd577a5e-0a92-4767-8957-5c5127e7da79 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.238006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08504eaf-db1c-4bfb-a5c5-91f3c0edb21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.239992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504eaf-db1c-4bfb-a5c5-91f3c0edb21b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.240438 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504eaf-db1c-4bfb-a5c5-91f3c0edb21b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.240918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504eaf-db1c-4bfb-a5c5-91f3c0edb21b None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.242902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08504eaf-db1c-4bfb-a5c5-91f3c0edb21b None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:39.243756 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08504eaf-db1c-4bfb-a5c5-91f3c0edb21b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:39.246645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 185/362] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:39.252126 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463659e-87ba-4e0a-9a52-6a9ed72357c5 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.252446 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463659e-87ba-4e0a-9a52-6a9ed72357c5 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.252728 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463659e-87ba-4e0a-9a52-6a9ed72357c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.272859 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-0463659e-87ba-4e0a-9a52-6a9ed72357c5 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:39.273458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-0463659e-87ba-4e0a-9a52-6a9ed72357c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:39.293029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.294516 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.294937 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.295369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.297426 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:39.300268 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:39.302804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 178/363] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:39.303822 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.326594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:39.360158 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 186/364] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:39.361086 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463659e-87ba-4e0a-9a52-6a9ed72357c5 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.442652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20103d9-c5fa-42ab-9dcc-af1b0fdcea8f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.476411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:39.485765 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463659e-87ba-4e0a-9a52-6a9ed72357c5 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.498936 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.499780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.500153 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.500673 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.516188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:39.527270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:39.528166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:39.529058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 179/365] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:39.529729 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.532045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.532976 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.533255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.534318 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.535836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:39.538106 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:39.539303 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 187/366] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:39.544397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.621645 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:39.663613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232ef6-29c7-47d5-b5f5-3210c675d2bb None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.683188 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d429c-3926-4449-a1e9-94d3ec1ae4b8 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.713961 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.714975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.715265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.715545 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.716852 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:39.720494 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:39.720494 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 180/367] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:39.721593 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.737383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.738525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.738805 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.739081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.750344 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:39.758973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:39.759873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:39.760761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:39.764477 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 188/368] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:39.765628 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.795464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:39.839890 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8eb1-d6ba-406c-a110-3715b18a3c1d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.880869 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.881537 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.881821 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.882093 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.882838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:39.883144 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:39.885497 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:39.901012 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 181/369] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:39.901012 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:39.903453 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:39.906679 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86fd61-59d9-45a9-b9c6-ba22f6eedc18 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:39.958133 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:39.959133 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:39.959423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:39.959701 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:39.960866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=035e92addbe344c6af8d3e395fe4390f) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:39.961192 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:39.962840 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:39.969504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 189/370] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=ae946283d08e403cba50982b7ee3d73a => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:39.970321 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.045970 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b5c8e-45f3-42fb-9338-1cea2501d025 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.090074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:40.100071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:40.101450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:40.101914 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:40.102681 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:40.104587 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=db905eb62199424a865391fb08241ee4, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:40.105153 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:40.107482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:40.110160 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb3730-5a8b-4971-8995-98d59130419a None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.116760 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 182/371] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=db905eb62199424a865391fb08241ee4 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:40.117973 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.203937 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:40.212135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:40.212911 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:40.213250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:40.213538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:40.214362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:40.214679 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:40.216114 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:40.240238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 190/372] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:40.252016 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3699-101b-4b5b-82d9-81a43ad5a22c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.260408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.298633 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:40.299582 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:40.300059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:40.301515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:40.388872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:40.391104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:40.463329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1319-ca7b-4954-bea4-25b0265bbaa5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.475627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:40.514998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:40.516347 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:40.516815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:40.517274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:40.520789 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 183/373] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:40.526091 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.549775 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:40.615963 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:40.619075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:40.637704 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54adf07-d5e2-4dc8-9e81-50676d172d8d None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.675189 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:40.676245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:40.676539 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:40.676815 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:40.678259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:40.679701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:40.681679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 184/374] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:40 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:40.688154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.728104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:40.745003 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 191/375] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:40.751132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.803869 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5740185-35ef-4ad6-9f5e-d765cae2f1a6 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.827343 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:40.844944 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:40.845818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:40.846102 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:40.846378 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:40.848193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:40.849766 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:40.851827 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 185/376] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:40 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:40.857830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.889636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fdd36-6fbc-4059-8119-9ccd32b50bb7 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.937460 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:40.938658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:40.939121 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:40.939584 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] PATH_INFO: `/v3/projects/b6df883a091541ef907c5fc4143c65b5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:40.941078 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] RBAC: Authorizing `identity:get_project(project_id=b6df883a091541ef907c5fc4143c65b5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:40.943307 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:40.949786 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 192/377] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:40 2022] GET /identity/v3/projects/b6df883a091541ef907c5fc4143c65b5 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:40.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:40.976227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a76258-1f95-4b09-aa72-9464082bd0d5 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:40.976227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:41.008911 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:41.009646 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:41.009931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:41.010206 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:41.011037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=db905eb62199424a865391fb08241ee4, scope.project.id=035e92addbe344c6af8d3e395fe4390f) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:41.011408 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:41.012943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:41.020383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 186/378] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:40 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=db905eb62199424a865391fb08241ee4 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:41.133176 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328fa2-5a78-4a9f-8aaf-e6631ba36292 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:41.155767 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:41.181247 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f5b9b-c8b5-49c3-813f-9b499802f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:41.182286 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f5b9b-c8b5-49c3-813f-9b499802f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:41.182578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f5b9b-c8b5-49c3-813f-9b499802f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:41.182874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f5b9b-c8b5-49c3-813f-9b499802f7c5 None admin] PATH_INFO: `/v3/groups/4ecb28d66d8341c98512769bc0a42a7a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:41.191826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f5b9b-c8b5-49c3-813f-9b499802f7c5 None admin] RBAC: Authorizing `identity:get_group(group_id=4ecb28d66d8341c98512769bc0a42a7a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:41.193332 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f5b9b-c8b5-49c3-813f-9b499802f7c5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:41.195051 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 193/379] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:40 2022] GET /identity/v3/groups/4ecb28d66d8341c98512769bc0a42a7a => generated 229 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:41.201316 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:41.250937 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43edcb2-8b67-4cde-8632-7a3bad2395b0 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:41.251258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43edcb2-8b67-4cde-8632-7a3bad2395b0 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:41.251506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43edcb2-8b67-4cde-8632-7a3bad2395b0 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:41.253301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 194/380] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:41.258531 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c536d-8b6f-4b4a-baa0-e1a1ecd97e60 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:41.258822 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c536d-8b6f-4b4a-baa0-e1a1ecd97e60 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:41.259111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c536d-8b6f-4b4a-baa0-e1a1ecd97e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:41.309246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-787c536d-8b6f-4b4a-baa0-e1a1ecd97e60 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:41.310477 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-787c536d-8b6f-4b4a-baa0-e1a1ecd97e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:41.329711 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109b622-5a1d-4e3a-bbd1-51b0756d5464 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:41.375475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:41.376151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:41.376464 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:41.376745 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:41.377579 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] RBAC: Adding query filter params (group.id=4ecb28d66d8341c98512769bc0a42a7a, role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=b6df883a091541ef907c5fc4143c65b5) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:41.378099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:41.381103 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:41.391686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 187/381] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:41 2022] GET /identity/v3/role_assignments?group.id=4ecb28d66d8341c98512769bc0a42a7a&scope.project.id=b6df883a091541ef907c5fc4143c65b5&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:41.437024 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 195/382] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:41.471639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:41.521184 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:41.605103 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80093-5edd-43ea-a5c5-e6f9ebe5970b None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:41.657847 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:41.658593 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:41.658889 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:41.659166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:41.674527 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:41.682639 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:41.683519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:41.684998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 188/383] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:41.689966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c536d-8b6f-4b4a-baa0-e1a1ecd97e60 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:41.831182 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c536d-8b6f-4b4a-baa0-e1a1ecd97e60 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:41.844517 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:41.870139 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:41.870782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:41.871070 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:41.871348 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:41.872110 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:41.872462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:41.873856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:41.884374 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 196/384] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:41.889902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:41.998936 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:42.010372 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576359da-aa5e-447a-a909-031655291ec7 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:42.050604 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:42.051472 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:42.051760 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:42.052039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:42.053251 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:42.054711 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:42.056669 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 189/385] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:41 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:42.062174 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:42.177445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3c562-31ba-4ee0-8b5a-6bc22acb36f8 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:42.219609 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf1ce6-7b0b-4046-b43b-228ae59cba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:42.220986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1ce6-7b0b-4046-b43b-228ae59cba9e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:42.221481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1ce6-7b0b-4046-b43b-228ae59cba9e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:42.221952 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf1ce6-7b0b-4046-b43b-228ae59cba9e None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:42.223425 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf1ce6-7b0b-4046-b43b-228ae59cba9e None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:42.225110 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf1ce6-7b0b-4046-b43b-228ae59cba9e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:42.228061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 197/386] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:42 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:42.232770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:42.380787 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8f2f2-158e-4205-a5f9-9f84d295ec51 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:42.428383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcaf0e-557a-48d3-bab0-f7bd1cbc743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:42.429275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcaf0e-557a-48d3-bab0-f7bd1cbc743e None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:42.429562 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcaf0e-557a-48d3-bab0-f7bd1cbc743e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:42.429843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcaf0e-557a-48d3-bab0-f7bd1cbc743e None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/groups/13a5a80397d0467b8a96a274721da187/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:42.431830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcaf0e-557a-48d3-bab0-f7bd1cbc743e None admin] RBAC: Authorizing `identity:create_grant(project_id=8587c9b4473e46e5ba5e45a48be5f54b, group_id=13a5a80397d0467b8a96a274721da187, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:42.433321 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcaf0e-557a-48d3-bab0-f7bd1cbc743e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:42.453466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 190/387] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Jul 14 18:49:42 2022] PUT /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/groups/13a5a80397d0467b8a96a274721da187/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:43.051915 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2298-c856-44dd-abf1-b4ab3823573d None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.052463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2298-c856-44dd-abf1-b4ab3823573d None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.052537 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2298-c856-44dd-abf1-b4ab3823573d None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.054113 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 198/388] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:43.061462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aea5b-57bf-4312-a57b-6edff3a400d3 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.061987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aea5b-57bf-4312-a57b-6edff3a400d3 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.062061 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aea5b-57bf-4312-a57b-6edff3a400d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.080860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ca2aea5b-57bf-4312-a57b-6edff3a400d3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:43.082131 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ca2aea5b-57bf-4312-a57b-6edff3a400d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:43.097115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:43.182536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 191/389] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:43.222781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b2298-c856-44dd-abf1-b4ab3823573d None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:43.282646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:43.284154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c58130-c009-43eb-96c6-08666f98d147 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.284785 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c58130-c009-43eb-96c6-08666f98d147 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.284785 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c58130-c009-43eb-96c6-08666f98d147 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.287836 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 192/390] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:43.293508 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bbfa0-2f0d-4f05-ac1b-6b36f7273c45 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.293798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bbfa0-2f0d-4f05-ac1b-6b36f7273c45 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.294080 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bbfa0-2f0d-4f05-ac1b-6b36f7273c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.314662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-cc7bbfa0-2f0d-4f05-ac1b-6b36f7273c45 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:43.315786 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-cc7bbfa0-2f0d-4f05-ac1b-6b36f7273c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:43.395572 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b2298-c856-44dd-abf1-b4ab3823573d None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:43.444528 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 193/391] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:43.463335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:43.464142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.464455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.464739 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.481421 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:43.489876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:43.490746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:43.491547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 199/392] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:43.497407 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bbfa0-2f0d-4f05-ac1b-6b36f7273c45 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:43.512939 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:43.616931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:43.650050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bbfa0-2f0d-4f05-ac1b-6b36f7273c45 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:43.720596 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:43.725518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dad96-14a6-4805-93ce-ef4aa38f36bc None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:43.732902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:43.733716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.733854 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.734127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.734881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:43.735191 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:43.736680 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:43.758143 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 194/393] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:43.764981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:43.765134 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:43.766180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.766697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.767175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.779401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:43.788526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:43.789428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:43.790224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:43.792896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 200/394] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:43.799314 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:43.919049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba11844-f622-49ca-bfed-f256ab8eaa23 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:43.957950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:43.958987 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:43.959503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:43.960040 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:43.961147 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:43.962225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:43.963836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:43.974746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 201/395] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:43.981635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.032613 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:44.077661 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d041f5-c9dd-4453-ad05-c05c94addb27 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.096745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd4bb-01b9-4c95-942a-b1f01eff210a None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.140392 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.141843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.142345 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.142827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.145284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:44.147092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:44.149705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 202/396] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:43 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:44.155705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.216941 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.217919 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.218168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.218446 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.224907 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:44.226660 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:44.228497 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 195/397] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:43 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:44.233914 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.258842 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:44.272226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:44.290090 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49453e1a-aab7-4fc2-a8a0-a574474e7d32 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.339699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa177-7782-4af4-a066-e2a040f7431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.340981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa177-7782-4af4-a066-e2a040f7431d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.341534 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa177-7782-4af4-a066-e2a040f7431d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.341994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa177-7782-4af4-a066-e2a040f7431d None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.343381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fa177-7782-4af4-a066-e2a040f7431d None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:44.345049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fa177-7782-4af4-a066-e2a040f7431d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:44.351504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 203/398] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:44 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:44.351504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c17e-0c8e-4b78-9802-6f0dd153724c None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.351504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c17e-0c8e-4b78-9802-6f0dd153724c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.351504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c17e-0c8e-4b78-9802-6f0dd153724c None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.352083 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 204/399] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:44.353260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b431c-da7f-45cc-8e78-e9b06a65afa2 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.354383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b431c-da7f-45cc-8e78-e9b06a65afa2 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.354668 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b431c-da7f-45cc-8e78-e9b06a65afa2 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.360462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 205/400] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:44.361115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b431c-da7f-45cc-8e78-e9b06a65afa2 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.386528 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0fb2-8d88-4951-8e63-b7b40e3ecec0 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.420885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271c0e4-1388-4652-9dce-9328b643a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.421743 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c0e4-1388-4652-9dce-9328b643a9fb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.422029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c0e4-1388-4652-9dce-9328b643a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.422294 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c0e4-1388-4652-9dce-9328b643a9fb None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.423492 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271c0e4-1388-4652-9dce-9328b643a9fb None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:44.424975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271c0e4-1388-4652-9dce-9328b643a9fb None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:44.431581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 196/401] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:44 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:44.431581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f421461-93c2-4c39-9e4f-4f119f4017a8 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.431581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f421461-93c2-4c39-9e4f-4f119f4017a8 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.431581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f421461-93c2-4c39-9e4f-4f119f4017a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.445664 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-6f421461-93c2-4c39-9e4f-4f119f4017a8 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:44.446853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-6f421461-93c2-4c39-9e4f-4f119f4017a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:44.477104 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b431c-da7f-45cc-8e78-e9b06a65afa2 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.512492 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.513380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.513669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.513955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/groups/13a5a80397d0467b8a96a274721da187/roles/db905eb62199424a865391fb08241ee4` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.516613 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] RBAC: Authorizing `identity:create_grant(project_id=8587c9b4473e46e5ba5e45a48be5f54b, group_id=13a5a80397d0467b8a96a274721da187, role_id=db905eb62199424a865391fb08241ee4)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:44.518090 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:44.523545 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 197/402] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:44.523545 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1aa36-2411-4a2f-837f-9798c09c4596 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.523762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1aa36-2411-4a2f-837f-9798c09c4596 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.523981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1aa36-2411-4a2f-837f-9798c09c4596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.540307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:44.546081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 206/403] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Jul 14 18:49:44 2022] PUT /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b/groups/13a5a80397d0467b8a96a274721da187/roles/db905eb62199424a865391fb08241ee4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:44.546758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.556232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-fbd1aa36-2411-4a2f-837f-9798c09c4596 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:44.556232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-fbd1aa36-2411-4a2f-837f-9798c09c4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:44.568867 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:44.661811 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 198/404] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:44.662596 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1aa36-2411-4a2f-837f-9798c09c4596 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.696694 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b83e9-e5aa-44dc-ae87-3fc7c01a4281 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.736913 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.737762 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.738609 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.738899 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f/groups/13a5a80397d0467b8a96a274721da187/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.741801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] RBAC: Authorizing `identity:create_grant(project_id=035e92addbe344c6af8d3e395fe4390f, group_id=13a5a80397d0467b8a96a274721da187, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:44.743271 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:44.759727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 207/405] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Jul 14 18:49:44 2022] PUT /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f/groups/13a5a80397d0467b8a96a274721da187/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:44.760397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.802621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1aa36-2411-4a2f-837f-9798c09c4596 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.842721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.843896 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.844417 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.844890 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.848944 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:44.851488 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:44.862542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:44.873193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:44.874180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:44.874963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:44.876774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b69dd-25fc-4887-a62a-af6a61af0586 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:44.878226 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 199/406] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:44.885593 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:44.937620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:44.938810 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:44.939337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:44.939844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:44.966397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:44.975390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:44.976419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:44.977216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:44.990255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 208/407] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:44.996544 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.048151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935824f-a13f-483f-95fb-5b89ef699641 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.094916 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.095542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.095856 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.096136 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.096929 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:45.097315 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.099150 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.107957 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 200/408] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:45.113651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.133571 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d817f-c4a4-4430-9a5c-12e811bbd6b6 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.177780 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fe1f6-fdec-4530-bd49-4c90af89db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.179450 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe1f6-fdec-4530-bd49-4c90af89db7e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.180425 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe1f6-fdec-4530-bd49-4c90af89db7e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.181161 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe1f6-fdec-4530-bd49-4c90af89db7e None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.182068 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fe1f6-fdec-4530-bd49-4c90af89db7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:45.182688 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fe1f6-fdec-4530-bd49-4c90af89db7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.184562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fe1f6-fdec-4530-bd49-4c90af89db7e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.191936 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:45.197169 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 209/409] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:45.197308 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:45.198775 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b19089-4eb8-4bac-8094-8316f9fbc59a None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.199582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b19089-4eb8-4bac-8094-8316f9fbc59a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.200136 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b19089-4eb8-4bac-8094-8316f9fbc59a None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.201876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 210/410] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:45.204101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b19089-4eb8-4bac-8094-8316f9fbc59a None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.248498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae80a6-b0d0-4118-ba9f-62e2b31c12fd None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.296831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dfd9f-346a-4107-a8db-d3de00063698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.297903 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dfd9f-346a-4107-a8db-d3de00063698 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.298358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dfd9f-346a-4107-a8db-d3de00063698 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.298778 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dfd9f-346a-4107-a8db-d3de00063698 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.300127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dfd9f-346a-4107-a8db-d3de00063698 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.302325 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dfd9f-346a-4107-a8db-d3de00063698 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.305420 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 201/411] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:45 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:45.307149 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005b3a-7e1d-4244-a7ff-f06cb8304b20 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.307584 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005b3a-7e1d-4244-a7ff-f06cb8304b20 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.308006 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005b3a-7e1d-4244-a7ff-f06cb8304b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.330215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-b6005b3a-7e1d-4244-a7ff-f06cb8304b20 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:45.330400 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b19089-4eb8-4bac-8094-8316f9fbc59a None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.332277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-b6005b3a-7e1d-4244-a7ff-f06cb8304b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:45.368451 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.369488 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.369878 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.370389 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] PATH_INFO: `/v3/groups/4ecb28d66d8341c98512769bc0a42a7a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.371738 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] RBAC: Authorizing `identity:get_group(group_id=4ecb28d66d8341c98512769bc0a42a7a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.373581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.375560 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 211/412] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:45 2022] GET /identity/v3/groups/4ecb28d66d8341c98512769bc0a42a7a => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:45.376351 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.427538 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 202/413] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:45.428920 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6005b3a-7e1d-4244-a7ff-f06cb8304b20 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.476019 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:45.493182 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:45.514480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5c37-0387-4f9d-a893-2cd66445e8c4 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.543221 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6005b3a-7e1d-4244-a7ff-f06cb8304b20 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.551147 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.552129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.552543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.552925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.554418 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.555977 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.557933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 212/414] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:45 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:45.558883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.581718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.582842 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.583270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.583720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] PATH_INFO: `/v3/projects/b6df883a091541ef907c5fc4143c65b5` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.585276 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] RBAC: Authorizing `identity:get_project(project_id=b6df883a091541ef907c5fc4143c65b5)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.586856 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.589074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 203/415] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:45 2022] GET /identity/v3/projects/b6df883a091541ef907c5fc4143c65b5 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:45.589940 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.664684 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f914f-cb9d-46ba-b7c7-ea644673b3a1 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.699582 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce97a-43af-43ba-b9f1-186f29246d0b None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.701444 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.703034 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.703034 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.703034 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.706206 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:45.716604 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:45.725704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:45.726814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:45.727809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:45.734407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 213/416] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:45.735466 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.739724 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:45.751309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.752570 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.753138 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.753587 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f/groups/13a5a80397d0467b8a96a274721da187/roles/db905eb62199424a865391fb08241ee4` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.756130 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] RBAC: Authorizing `identity:create_grant(project_id=035e92addbe344c6af8d3e395fe4390f, group_id=13a5a80397d0467b8a96a274721da187, role_id=db905eb62199424a865391fb08241ee4)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.757971 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.773011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 204/417] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Jul 14 18:49:45 2022] PUT /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f/groups/13a5a80397d0467b8a96a274721da187/roles/db905eb62199424a865391fb08241ee4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:45.774134 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.885117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faed120-3dc1-4516-b566-2393c9a024ed None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.907709 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a251c-7be4-4b19-9411-6ac1ad4574a5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:45.926297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.927403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.927918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.928436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.929398 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:45.929953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.931556 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.942455 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 205/418] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:45.951423 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:45.971541 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:45.973163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:45.973677 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:45.973897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] PATH_INFO: `/v3/projects/b6df883a091541ef907c5fc4143c65b5/groups/4ecb28d66d8341c98512769bc0a42a7a/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:45.980260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6df883a091541ef907c5fc4143c65b5, group_id=4ecb28d66d8341c98512769bc0a42a7a, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:45.980260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:45.998607 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 214/419] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Jul 14 18:49:45 2022] PUT /identity/v3/projects/b6df883a091541ef907c5fc4143c65b5/groups/4ecb28d66d8341c98512769bc0a42a7a/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:49:46.038951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:46.093389 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c265-123f-480f-b87b-f44a101d9de0 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:46.132907 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:46.134298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:46.134732 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:46.135153 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:46.215036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:46.216894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:46.275334 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:46.328168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 206/420] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:46.334280 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:46.398899 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:46.449598 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f490403-3016-485a-ac87-b1c9a8e4ec25 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:46.499035 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:46.499912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:46.500220 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:46.500502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:46.501836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:46.503357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:46.505848 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 215/421] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:46 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:46.511431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:46.620679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75b178-583b-4791-b0f0-a527535b5148 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:46.656923 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643894f2-c50a-454a-ad34-e65ba5d6a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:46.657787 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643894f2-c50a-454a-ad34-e65ba5d6a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:46.658069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643894f2-c50a-454a-ad34-e65ba5d6a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:46.658342 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643894f2-c50a-454a-ad34-e65ba5d6a5d6 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:46.659674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643894f2-c50a-454a-ad34-e65ba5d6a5d6 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:46.661262 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643894f2-c50a-454a-ad34-e65ba5d6a5d6 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:46.663247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 207/422] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:46 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:46.669275 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:46.793184 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7e939-24b7-4687-8f7e-73b8ffb33b57 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:46.829256 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:46.841010 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cd3a1-c0ba-45d5-80d8-7375638a4ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:46.841745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd3a1-c0ba-45d5-80d8-7375638a4ad6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:46.842033 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd3a1-c0ba-45d5-80d8-7375638a4ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:46.842346 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cd3a1-c0ba-45d5-80d8-7375638a4ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:46.843194 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd3a1-c0ba-45d5-80d8-7375638a4ad6 None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:46.843512 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd3a1-c0ba-45d5-80d8-7375638a4ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:46.845033 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cd3a1-c0ba-45d5-80d8-7375638a4ad6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:46.856625 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 216/423] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:46 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=ae946283d08e403cba50982b7ee3d73a => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:47.121934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1017ed0-0117-47fd-b1ff-f934148a85d4 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.122346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1017ed0-0117-47fd-b1ff-f934148a85d4 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.122471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1017ed0-0117-47fd-b1ff-f934148a85d4 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.123845 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 208/424] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:47.141189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcad424-546b-4934-9437-fa796634deee None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.142509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcad424-546b-4934-9437-fa796634deee None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.142802 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcad424-546b-4934-9437-fa796634deee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.166522 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-edcad424-546b-4934-9437-fa796634deee None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:47.167724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-edcad424-546b-4934-9437-fa796634deee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:47.240469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 217/425] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:47.267560 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1017ed0-0117-47fd-b1ff-f934148a85d4 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:47.288877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:47.392787 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1017ed0-0117-47fd-b1ff-f934148a85d4 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:47.431747 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b3a38-f17f-4e87-9c2d-c93ff8d38f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:47.432629 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3a38-f17f-4e87-9c2d-c93ff8d38f32 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.432909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3a38-f17f-4e87-9c2d-c93ff8d38f32 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.433183 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3a38-f17f-4e87-9c2d-c93ff8d38f32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.450814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b3a38-f17f-4e87-9c2d-c93ff8d38f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-ef4b3a38-f17f-4e87-9c2d-c93ff8d38f32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:47.459331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:47.460242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:47.461044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:47.463661 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 209/426] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:47.467509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcad424-546b-4934-9437-fa796634deee None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:47.509162 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef7de2-8765-4632-95dd-a6ede1056563 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.509714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef7de2-8765-4632-95dd-a6ede1056563 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.510249 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef7de2-8765-4632-95dd-a6ede1056563 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.512153 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 210/427] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:47.517665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067ed1-699b-48de-8187-cd9a6943d98f None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.518185 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067ed1-699b-48de-8187-cd9a6943d98f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.518680 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067ed1-699b-48de-8187-cd9a6943d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.537796 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-88067ed1-699b-48de-8187-cd9a6943d98f None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:47.539506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-88067ed1-699b-48de-8187-cd9a6943d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:47.604267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcad424-546b-4934-9437-fa796634deee None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:47.626038 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:47.632219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 211/428] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:47.653703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:47.654770 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.655238 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88067ed1-699b-48de-8187-cd9a6943d98f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:47.655445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.655925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.656897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:47.657743 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:47.659466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:47.661753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:47.679845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 218/429] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:47.681603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:47.778556 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88067ed1-699b-48de-8187-cd9a6943d98f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:47.795246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c99faf-33bc-4b98-aa5f-f31c05710660 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:47.817993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:47.818790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.819071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.819700 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.830257 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:47.836057 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:47.836986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.837467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.837934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:47.838237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:47.839108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:47.840329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 212/430] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:47.845835 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:47.896524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:47.913767 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:47.922811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:47.924621 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:47.954510 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b379-0ed5-457a-ad69-58707b0707d4 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:47.990096 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:47.990769 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:47.991073 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:47.991373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:47.992081 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:47.992466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:47.994103 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.003509 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 213/431] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:49:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:48.009549 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.044112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 219/432] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:48.045901 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.126999 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2cf74-d906-48c4-bc75-4aa57610dac6 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.152398 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:48.157097 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:48.167539 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.168182 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.168507 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.169079 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.181761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e859-a715-4ccb-ba7b-fe202474610e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.222963 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.224408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.224903 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.225372 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] PATH_INFO: `/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.226877 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] RBAC: Authorizing `identity:get_project(project_id=8587c9b4473e46e5ba5e45a48be5f54b)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:48.228633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.235323 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 220/433] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/projects/8587c9b4473e46e5ba5e45a48be5f54b => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:48.236816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.256530 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:48.258876 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.359014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87edb-97f6-4b36-982a-567c6a284e6d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.380247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 214/434] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:48.383930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.400685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.401704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.402096 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.402479 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.403874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:48.405549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.412245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 221/435] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:48.414649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.421347 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:48.437425 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:48.533941 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c47a3-470b-415f-9c8b-fe2290362b95 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.541417 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e59e15-0867-4384-a112-ce9b5f859608 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.574604 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.575456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.575733 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.576011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.577208 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:48.578828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.582994 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 215/436] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:48.586485 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.589348 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e731-e2b6-4986-8b05-bb7bf1be4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.590241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e731-e2b6-4986-8b05-bb7bf1be4f27 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.590719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e731-e2b6-4986-8b05-bb7bf1be4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.591229 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e731-e2b6-4986-8b05-bb7bf1be4f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.592296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e731-e2b6-4986-8b05-bb7bf1be4f27 None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=db905eb62199424a865391fb08241ee4, scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:48.592864 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e731-e2b6-4986-8b05-bb7bf1be4f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:48.594582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e731-e2b6-4986-8b05-bb7bf1be4f27 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.608214 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 222/437] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=8587c9b4473e46e5ba5e45a48be5f54b&role.id=db905eb62199424a865391fb08241ee4 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:48.636295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7db55-e4fb-4eae-820e-d3bc94380a9a None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.636612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7db55-e4fb-4eae-820e-d3bc94380a9a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.636873 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7db55-e4fb-4eae-820e-d3bc94380a9a None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.638533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 223/438] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:49:48.644111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacec1-876a-40c8-92dc-9bdd1bff99fc None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.644577 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacec1-876a-40c8-92dc-9bdd1bff99fc None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.644741 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacec1-876a-40c8-92dc-9bdd1bff99fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.663835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-1fbacec1-876a-40c8-92dc-9bdd1bff99fc None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:48.665098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-1fbacec1-876a-40c8-92dc-9bdd1bff99fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:48.698346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:48.706290 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786018a4-6440-4fd9-8959-56d226122d26 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.748364 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.749674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.750177 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.750691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.760236 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 224/439] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:48.760436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:48.760436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.762162 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 216/440] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:48.763817 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbacec1-876a-40c8-92dc-9bdd1bff99fc None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.779354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:48.781513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:48.888858 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbacec1-876a-40c8-92dc-9bdd1bff99fc None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.912184 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba554942-2584-471a-bfd8-f143c1e78546 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:48.929094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2fed4-4a0c-4058-bd4a-3db990367fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.929750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2fed4-4a0c-4058-bd4a-3db990367fad None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.930032 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2fed4-4a0c-4058-bd4a-3db990367fad None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.930304 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2fed4-4a0c-4058-bd4a-3db990367fad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.931220 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2fed4-4a0c-4058-bd4a-3db990367fad None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=ae946283d08e403cba50982b7ee3d73a, scope.project.id=035e92addbe344c6af8d3e395fe4390f) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:48.931451 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2fed4-4a0c-4058-bd4a-3db990367fad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:48.933135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2fed4-4a0c-4058-bd4a-3db990367fad None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:48.943114 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 225/441] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=ae946283d08e403cba50982b7ee3d73a => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:48.944844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9640f-6310-47ea-a976-9fa78e9c6b8b None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.945134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9640f-6310-47ea-a976-9fa78e9c6b8b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.945737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9640f-6310-47ea-a976-9fa78e9c6b8b None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.948314 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 226/442] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:48.955406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:48.955406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.955656 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9858-3baa-4859-96be-2e6fc5204503 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:48.955729 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.955815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9858-3baa-4859-96be-2e6fc5204503 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:48.955884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.955950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9858-3baa-4859-96be-2e6fc5204503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:48.969035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:48.974528 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-43ae9858-3baa-4859-96be-2e6fc5204503 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:48.975773 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-43ae9858-3baa-4859-96be-2e6fc5204503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:48.977605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:48.978589 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:48.979546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 217/443] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:48.985022 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.015366 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.065636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 227/444] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:49.091749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9858-3baa-4859-96be-2e6fc5204503 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.095949 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.122352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e9a7-b631-45bf-bfa7-6acb6a3c3923 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.165438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.166416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.166725 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.167004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.167752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:49.168057 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.169451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.179422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 218/445] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:49.185415 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.221851 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9858-3baa-4859-96be-2e6fc5204503 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.261988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.262729 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.263018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.263293 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.278402 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:49.286745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:49.287633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:49:49.288578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:49.293157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 228/446] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:49.293992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.294125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.317690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeeff3-98dd-4743-97ac-a34dd6001007 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.357817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.358464 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.358744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.359019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.362038 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.400167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ce5d-ea71-4ce9-90ab-c69b044865c5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.425544 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.427518 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.434266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.434934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.435223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.435523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.436288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:49.436603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.437977 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.446129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 229/447] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:49.451593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.510078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.527145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 219/448] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:49.532665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.552253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407933cf-ff9e-4be4-8431-826d637470bf None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.579248 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.588706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.589355 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.589632 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.589917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.629770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0efaf0-91ec-4e75-ab70-020133496fbb None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.657379 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.658836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.663938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.664829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.665114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.665388 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] PATH_INFO: `/v3/projects/035e92addbe344c6af8d3e395fe4390f` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.666830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] RBAC: Authorizing `identity:get_project(project_id=035e92addbe344c6af8d3e395fe4390f)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.668446 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.670132 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 220/449] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/projects/035e92addbe344c6af8d3e395fe4390f => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:49.675452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.730598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.759456 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 230/450] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:49:49.764964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.776429 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a66894-7b3d-4c45-a49c-f5dd1c725a83 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.791560 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.811377 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.812256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.812545 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.812820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] PATH_INFO: `/v3/groups/13a5a80397d0467b8a96a274721da187` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.814047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] RBAC: Authorizing `identity:get_group(group_id=13a5a80397d0467b8a96a274721da187)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.815510 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.817154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 221/451] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/groups/13a5a80397d0467b8a96a274721da187 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:49.822794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.864830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15118223-e165-4a9f-b7a9-b6d71797ffee None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.898455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.899316 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.899600 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.899878 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] PATH_INFO: `/v3/projects/b6df883a091541ef907c5fc4143c65b5` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.901112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=b6df883a091541ef907c5fc4143c65b5)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.902552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.904258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 231/452] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/projects/b6df883a091541ef907c5fc4143c65b5 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:49.909549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:49.922457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787abc2c-a857-407a-83f0-e83682028316 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:49.944010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:49.959643 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:49.960423 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:49.960781 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:49.961068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:49.961898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] RBAC: Adding query filter params (group.id=13a5a80397d0467b8a96a274721da187, role.id=db905eb62199424a865391fb08241ee4, scope.project.id=035e92addbe344c6af8d3e395fe4390f) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:49.962215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:49.963649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:49.969552 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 222/453] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/role_assignments?group.id=13a5a80397d0467b8a96a274721da187&scope.project.id=035e92addbe344c6af8d3e395fe4390f&role.id=db905eb62199424a865391fb08241ee4 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:50.006201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:50.013898 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf8e1-dee2-40a5-b2b5-43dda6ce4fd0 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:50.051587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b2c0b-16bd-40b7-8009-878b8b0d0910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:50.052409 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2c0b-16bd-40b7-8009-878b8b0d0910 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:50.052694 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2c0b-16bd-40b7-8009-878b8b0d0910 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:50.052970 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2c0b-16bd-40b7-8009-878b8b0d0910 None admin] PATH_INFO: `/v3/groups/4ecb28d66d8341c98512769bc0a42a7a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:50.054227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b2c0b-16bd-40b7-8009-878b8b0d0910 None admin] RBAC: Authorizing `identity:get_group(group_id=4ecb28d66d8341c98512769bc0a42a7a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:50.055705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b2c0b-16bd-40b7-8009-878b8b0d0910 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:50.057416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 232/454] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Jul 14 18:49:49 2022] GET /identity/v3/groups/4ecb28d66d8341c98512769bc0a42a7a => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:50.063528 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:50.166970 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7011e0-e53a-4727-8a7f-1b1e224818cc None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:50.200822 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89573-d52e-4422-8814-a66cb6c31aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:50.201479 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89573-d52e-4422-8814-a66cb6c31aed None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:50.201765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89573-d52e-4422-8814-a66cb6c31aed None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:50.202044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89573-d52e-4422-8814-a66cb6c31aed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:50.202869 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89573-d52e-4422-8814-a66cb6c31aed None admin] RBAC: Adding query filter params (group.id=4ecb28d66d8341c98512769bc0a42a7a, role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=b6df883a091541ef907c5fc4143c65b5) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:50.203190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89573-d52e-4422-8814-a66cb6c31aed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:50.204738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89573-d52e-4422-8814-a66cb6c31aed None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:50.210626 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 223/455] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Jul 14 18:49:50 2022] GET /identity/v3/role_assignments?group.id=4ecb28d66d8341c98512769bc0a42a7a&scope.project.id=b6df883a091541ef907c5fc4143c65b5&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:52.716179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375198f7-4abe-45f5-ad65-275ed1d96df7 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:52.716748 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375198f7-4abe-45f5-ad65-275ed1d96df7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:52.716748 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375198f7-4abe-45f5-ad65-275ed1d96df7 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:52.718319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 233/456] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:52.723777 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d9b04-d51b-47f9-8153-2dbc9a524d01 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:52.724227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d9b04-d51b-47f9-8153-2dbc9a524d01 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:52.724409 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d9b04-d51b-47f9-8153-2dbc9a524d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:52.743265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-7e9d9b04-d51b-47f9-8153-2dbc9a524d01 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:52.744536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-7e9d9b04-d51b-47f9-8153-2dbc9a524d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:52.796849 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:52.821988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 224/457] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:52.846514 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375198f7-4abe-45f5-ad65-275ed1d96df7 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:52.908506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a330f1-cb8c-4fa8-b49d-19692b8a6c9d None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:52.908836 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a330f1-cb8c-4fa8-b49d-19692b8a6c9d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:52.909059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a330f1-cb8c-4fa8-b49d-19692b8a6c9d None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:52.910744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 225/458] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:52.916458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18cfd-23fc-4659-bbcd-2e548ff28eb0 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:52.916812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18cfd-23fc-4659-bbcd-2e548ff28eb0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:52.917094 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18cfd-23fc-4659-bbcd-2e548ff28eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:52.935902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-b5a18cfd-23fc-4659-bbcd-2e548ff28eb0 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:52.937105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-b5a18cfd-23fc-4659-bbcd-2e548ff28eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:52.964968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375198f7-4abe-45f5-ad65-275ed1d96df7 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.002082 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.002802 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.003088 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.003369 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.015515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.016163 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 226/459] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:53.017053 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:53.035719 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:53.036629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:53.037459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:53.037459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:53.037459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.037459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:53.037459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 234/460] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:53.044048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a18cfd-23fc-4659-bbcd-2e548ff28eb0 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.045523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.063605 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:53.156106 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1e81-a152-460c-b9cd-30b4fe4ec261 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.163956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a18cfd-23fc-4659-bbcd-2e548ff28eb0 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.178231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:53.195758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60872375-6833-489d-9407-0e20adb06f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.196588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60872375-6833-489d-9407-0e20adb06f3f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.196864 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60872375-6833-489d-9407-0e20adb06f3f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.197136 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60872375-6833-489d-9407-0e20adb06f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.207884 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60872375-6833-489d-9407-0e20adb06f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.209396 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60872375-6833-489d-9407-0e20adb06f3f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.211967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.212533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.212815 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.213089 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.213809 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:53.214117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.215471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-60872375-6833-489d-9407-0e20adb06f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:53.227538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:53.228658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 235/461] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf88ef-7a46-488d-9bba-0d1dfc5c2b0f None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf88ef-7a46-488d-9bba-0d1dfc5c2b0f None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf88ef-7a46-488d-9bba-0d1dfc5c2b0f None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.234503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 236/462] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:53.234980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 227/463] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:53.235049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf88ef-7a46-488d-9bba-0d1dfc5c2b0f None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.235115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.314800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:53.344356 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5b9a7-2ccb-4c93-85e0-2609a83e67d4 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.349789 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf88ef-7a46-488d-9bba-0d1dfc5c2b0f None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.378265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f241-e589-42d3-81dd-535b1522dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.378951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f241-e589-42d3-81dd-535b1522dcbb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.379230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f241-e589-42d3-81dd-535b1522dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.379500 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f241-e589-42d3-81dd-535b1522dcbb None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.380222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f241-e589-42d3-81dd-535b1522dcbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:53.380546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f241-e589-42d3-81dd-535b1522dcbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.381903 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f241-e589-42d3-81dd-535b1522dcbb None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.383320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc878b54-836f-4806-91df-efd7d3b6b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.383989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc878b54-836f-4806-91df-efd7d3b6b679 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.384301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc878b54-836f-4806-91df-efd7d3b6b679 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.384587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc878b54-836f-4806-91df-efd7d3b6b679 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.385290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc878b54-836f-4806-91df-efd7d3b6b679 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.386718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc878b54-836f-4806-91df-efd7d3b6b679 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.393637 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 228/464] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:53.395353 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7edf4-8505-412f-b5cd-a5c3b00c7282 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.395961 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7edf4-8505-412f-b5cd-a5c3b00c7282 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.395961 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7edf4-8505-412f-b5cd-a5c3b00c7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.408868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 237/465] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:53 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:53.410707 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44ed6-313d-423f-9269-9a97ad846828 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.411003 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44ed6-313d-423f-9269-9a97ad846828 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.411290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44ed6-313d-423f-9269-9a97ad846828 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.412582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 238/466] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:53.417406 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44ed6-313d-423f-9269-9a97ad846828 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.424568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-f7d7edf4-8505-412f-b5cd-a5c3b00c7282 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:53.425829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-f7d7edf4-8505-412f-b5cd-a5c3b00c7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:53.451664 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:53.503029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 229/467] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:53.504574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0e6d-736d-48c7-9755-cb2ecdf57d79 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.504934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0e6d-736d-48c7-9755-cb2ecdf57d79 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.505288 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0e6d-736d-48c7-9755-cb2ecdf57d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.529918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-335c0e6d-736d-48c7-9755-cb2ecdf57d79 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:53.531233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-335c0e6d-736d-48c7-9755-cb2ecdf57d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:53.550191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44ed6-313d-423f-9269-9a97ad846828 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.575145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:53.591552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.592261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.592564 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.592833 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.593985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.595003 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.607679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 230/468] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:53.608568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0e6d-736d-48c7-9755-cb2ecdf57d79 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.616583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 239/469] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:53 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:53.641001 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.724082 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:53.741207 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0e6d-736d-48c7-9755-cb2ecdf57d79 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.786873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.787769 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.788152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.788586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.793706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6fad-1002-42bf-be60-9f162a072bc7 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:53.801249 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.802726 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:53.822387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:53.823306 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:53.824137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:53.824137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:53.824137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.824137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:53.824137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 231/470] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:53.830184 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.838936 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:53.839813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:53.840111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:53.840464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:53.854041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:53.855957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:53.876502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:53.877390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:53.878240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:53.878240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:53.878240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:53.878240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:53.878240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 240/471] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:53.883731 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:53.923763 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:53.958072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b787a0-a507-49fa-96e3-432ade37a2bc None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:54.007273 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f7820-c7b1-4d95-adeb-27303efe3e6e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:54.009937 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:54.010619 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:54.010906 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:54.011189 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:54.011927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:54.012278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:54.014674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:54.026223 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:54.032495 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 232/472] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:54.041507 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:54.054500 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:54.055180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:54.055469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:54.055749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:54.056528 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:54.056845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:54.058218 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:54.076240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 241/473] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:54.076240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:54.163465 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a39b-3d68-421a-8021-c3f6359c5593 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:54.177836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:54.189390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf31ec-87d1-4036-b5c6-bbcba2de8ee3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:54.201319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002d3c-03b6-48c3-8be2-413096639f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:54.201996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002d3c-03b6-48c3-8be2-413096639f88 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:54.202283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002d3c-03b6-48c3-8be2-413096639f88 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:54.202580 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002d3c-03b6-48c3-8be2-413096639f88 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:54.203406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4002d3c-03b6-48c3-8be2-413096639f88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:54.205019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4002d3c-03b6-48c3-8be2-413096639f88 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:54.230457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 233/474] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:54 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:49:54.232492 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f5f7-4f61-495f-9941-6692d35567fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:54.233234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f5f7-4f61-495f-9941-6692d35567fe None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:54.233523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f5f7-4f61-495f-9941-6692d35567fe None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:54.233805 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f5f7-4f61-495f-9941-6692d35567fe None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:54.234529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f5f7-4f61-495f-9941-6692d35567fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:54.237111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f5f7-4f61-495f-9941-6692d35567fe None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:54.261989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 242/475] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:49:54 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:49:55.774756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745db1-c397-41cf-a702-70065c10cc27 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:55.775277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745db1-c397-41cf-a702-70065c10cc27 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:55.775386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745db1-c397-41cf-a702-70065c10cc27 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:55.776952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 234/476] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:55.782280 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce1fe9-8851-465d-b073-fe6151dccea6 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:55.782664 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce1fe9-8851-465d-b073-fe6151dccea6 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:55.782838 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce1fe9-8851-465d-b073-fe6151dccea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:55.801922 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-89ce1fe9-8851-465d-b073-fe6151dccea6 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:55.803147 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-89ce1fe9-8851-465d-b073-fe6151dccea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:55.871658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 243/477] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:55.896604 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745db1-c397-41cf-a702-70065c10cc27 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:55.960083 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:56.008900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745db1-c397-41cf-a702-70065c10cc27 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.044958 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.045675 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.045967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.046245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.057657 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:56.061225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593b47f-b714-44ec-bf45-f682705e1056 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.061735 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593b47f-b714-44ec-bf45-f682705e1056 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.062214 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593b47f-b714-44ec-bf45-f682705e1056 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.064015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 244/478] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:56.067980 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:56.068934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:56.069727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 235/479] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:49:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:56.072085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e24f-c62a-4253-96b7-624422847eab None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.072603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e24f-c62a-4253-96b7-624422847eab None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.072706 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.073190 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e24f-c62a-4253-96b7-624422847eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.091075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-1876e24f-c62a-4253-96b7-624422847eab None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:56.092713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-1876e24f-c62a-4253-96b7-624422847eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:56.164434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 245/480] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:49:56.186230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554a813-f64b-4895-be62-0a9f16a2e0d1 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.188000 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e24f-c62a-4253-96b7-624422847eab None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.204589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:56.208329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:56.234470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.235767 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.237057 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.237558 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.239068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:56.239560 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:56.241220 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:56.253258 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 236/481] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:49:56.265386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.325931 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e24f-c62a-4253-96b7-624422847eab None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.366973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.368014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.368512 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.368935 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.381005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:56.389238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:56.390291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:56.391462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:56.395329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 246/482] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:49:56.404254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.404415 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee0081-dba1-42a4-88fa-ad8d99725563 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.450894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.452136 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.452527 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.452804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.471606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:56.474114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:56.475925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:56.504360 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:56.505440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:56.506300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:56.506300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:56.506300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:56.506300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:56.506300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 237/483] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:56.512102 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.525033 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc1d-4d2f-4be5-a20a-c5da62d4d786 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.558153 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:56.565973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.567938 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.568467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.568897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.569807 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] RBAC: Adding query filter params (name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:56.570267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:56.571931 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:56.582296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 247/484] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:56.592246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.647078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7803412-6f23-48f4-9492-5ab6b193d848 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.682909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15778b36-323d-4b9b-89d8-44ba6934a66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.683566 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15778b36-323d-4b9b-89d8-44ba6934a66c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.683854 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15778b36-323d-4b9b-89d8-44ba6934a66c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.684132 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15778b36-323d-4b9b-89d8-44ba6934a66c None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.684886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15778b36-323d-4b9b-89d8-44ba6934a66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:56.685195 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15778b36-323d-4b9b-89d8-44ba6934a66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:56.686564 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15778b36-323d-4b9b-89d8-44ba6934a66c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:56.694964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ac7bf-066f-4d22-a1db-7f5d634fabbe None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.698754 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 238/485] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:56.700102 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199de8c-d8bd-486a-86d8-5073723f8953 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.700425 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199de8c-d8bd-486a-86d8-5073723f8953 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.700701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199de8c-d8bd-486a-86d8-5073723f8953 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.702218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 239/486] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:56.703482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf807-803a-4772-b441-25f6083468a3 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.703763 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf807-803a-4772-b441-25f6083468a3 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.704036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf807-803a-4772-b441-25f6083468a3 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.708254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 240/487] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:49:56.708254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf807-803a-4772-b441-25f6083468a3 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.726803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:56.736173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b06c5-3156-49d7-ab2d-08156a50be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.736998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b06c5-3156-49d7-ab2d-08156a50be3f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.737281 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b06c5-3156-49d7-ab2d-08156a50be3f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.737557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b06c5-3156-49d7-ab2d-08156a50be3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.748392 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b06c5-3156-49d7-ab2d-08156a50be3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:56.749830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b06c5-3156-49d7-ab2d-08156a50be3f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-f66b06c5-3156-49d7-ab2d-08156a50be3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:56.767956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:56.768895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:56.770267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:56.770267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:56.770267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:56.770267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:56.770267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 248/488] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:56.771170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9ca53-2941-493d-979c-b7a9476e7086 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.771469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9ca53-2941-493d-979c-b7a9476e7086 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.771755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9ca53-2941-493d-979c-b7a9476e7086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.789169 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-36b9ca53-2941-493d-979c-b7a9476e7086 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:56.790375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-36b9ca53-2941-493d-979c-b7a9476e7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:56.805641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:56.818266 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf807-803a-4772-b441-25f6083468a3 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:56.853884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:56.854590 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.854870 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.855144 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] PATH_INFO: `/v3/users/nova` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.862476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:56.863940 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:56.871089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 249/489] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:56.872410 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f378ff-223a-47d3-a3aa-f85b56993fe3 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:56.872703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f378ff-223a-47d3-a3aa-f85b56993fe3 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:56.872978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f378ff-223a-47d3-a3aa-f85b56993fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:49:56.880487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:56.881505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 241/490] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:56.882405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.899055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-e9f378ff-223a-47d3-a3aa-f85b56993fe3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:49:56.900277 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-e9f378ff-223a-47d3-a3aa-f85b56993fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:49:56.969753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 250/491] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:49:56.973107 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f378ff-223a-47d3-a3aa-f85b56993fe3 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:56.986986 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472866ac-6414-4f84-8f90-86453e249578 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.014723 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.022147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.022817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.023101 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.023379 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.024110 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:57.024451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.025853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.037448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 242/492] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:57.038232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.051470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.073385 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f378ff-223a-47d3-a3aa-f85b56993fe3 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.107172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.107777 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.108062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.108371 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.109209 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:57.109519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.110955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.139436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b67ea-ab28-4e44-b2cc-2a20f9a518df None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.148142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 251/493] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Jul 14 18:49:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:57.148995 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.172862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.173648 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.173928 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.174200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.184540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:57.193009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:57.194070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 243/494] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:57.195063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.249047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.252641 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529894-0c43-434d-9fd4-03c74f26b8d5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.271800 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.289717 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.290559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.291136 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.291457 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.301995 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:49:57.303693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac41b-0eed-4366-a9d1-a396f3c2b114 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:49:57.310047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:57.310953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:57.311755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 252/495] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:57.312465 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.340962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.341758 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.342043 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.342331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] PATH_INFO: `/v3/users/glance` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.350515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.351974 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:49:57.366565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:57.367627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 244/496] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:57.368740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.414422 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aba61-ca89-4224-89f3-bbffb81b6d05 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.447459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.448109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.448427 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.448715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.466742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ff10-7d3e-47d0-a87f-3cd5d275a27b None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.476271 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.494717 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.500746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.501407 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.501694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.501981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.502719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:57.503030 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.504459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.513069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 245/497] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:57.513867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.523918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.525424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.611420 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3acb-4075-424e-8dca-095365f52500 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.623114 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 253/498] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:57.623884 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.645233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.645893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.646190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.646469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.647210 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:57.647522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.648927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.656718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 246/499] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:57.657487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.683582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.715746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.725176 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da13ce-9e23-432a-ab58-6d3e623d182e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.758740 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.759407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.759691 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.759968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.760833 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:57.760982 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d34e-d0d7-4498-985e-e3e7da208d01 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.761143 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.762693 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.779357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 254/500] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:57.780148 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.794256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d8217-eb06-49af-a146-041e95721731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.795071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d8217-eb06-49af-a146-041e95721731 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.795359 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d8217-eb06-49af-a146-041e95721731 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.795633 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d8217-eb06-49af-a146-041e95721731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.806696 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d8217-eb06-49af-a146-041e95721731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.808138 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d8217-eb06-49af-a146-041e95721731 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-726d8217-eb06-49af-a146-041e95721731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:57.825078 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:57.826060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:57.826900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:57.826900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:57.826900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:57.826900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:57.826900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 247/501] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:57.827161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d8217-eb06-49af-a146-041e95721731 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.883919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd73ca-0f13-49ae-a8bf-f72295238705 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.900331 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.919353 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.920152 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.920473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.920755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.925744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d8217-eb06-49af-a146-041e95721731 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:57.930739 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.932218 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.932606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:57.950234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:57.951290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:57.957800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:57.957800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:57.957800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:57.957800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:57.957800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 255/502] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:57.957800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:57.961168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:57.961953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:57.962240 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:57.962514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:57.973139 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:57.974583 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:57.992013 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:57.993039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:57.993902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:57.993902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:57.993902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:57.993902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:57.993902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 248/503] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:57.994157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.057532 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb62c95-f301-4da9-b711-1884b91dbcd6 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.090728 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.091364 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.091647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.091921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.092652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84306c3-fbca-40b7-9ca5-5fbd98e0c113 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.125324 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.125976 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.126633 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.127009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.127186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.127900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:58.128241 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.130514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.141942 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 249/504] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:58.142668 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.161747 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.163401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.165081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.240468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79f14-59ba-48a2-9f1d-fbc30f9019f0 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.262637 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 256/505] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:58.263497 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.281476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.282148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.282435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.282713 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.283436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:58.283744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.285695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.297772 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 250/506] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:58.298553 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.332308 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.364014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0323f-e87a-420d-80e3-c9d862e32e89 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.376325 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.398916 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c733-df38-4620-8d01-b78aaf589173 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.399053 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.399593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.399884 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.400305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.400920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:58.401238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.402620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.413868 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 257/507] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:58.414601 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.437969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.438793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.439079 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.439355 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.446910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.448364 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:49:58.463117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:58.464044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:58.464983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 251/508] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:58.465535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.513658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1925d8-f2d7-4920-ad45-208853e61cb6 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.543041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.551089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.552287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.552577 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.552856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.564311 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.565769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.569815 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919a4fb-703f-4f90-b413-7132e442fe4c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:58.583595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:58.584542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:58.585490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:58.585490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:58.585490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:58.585490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:58.585490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 258/509] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:58.585766 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.605637 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.606423 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.606708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.606987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.613824 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.615260 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.616993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:49:58.630829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:58.631684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:49:58.632595 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 252/510] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:58.633072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.689945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb34e3-880c-4d50-a003-9b11ac273ae0 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.723006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.723803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.724088 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.724405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.731745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.733257 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.733592 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf046b-505c-4d5e-93dc-fa73aa25f14a None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:49:58.749112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:58.750027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:58.750914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 259/511] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:58.751505 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.769217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.769891 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.770169 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.770449 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.771278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:58.771590 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.773056 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.791965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.809160 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 253/512] 10.222.0.72 () {56 vars in 1139 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:58.809978 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.864879 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532dfd2-5a16-4828-880f-51ef9196abf1 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.867816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:58.899065 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.899729 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.900015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.900329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.901057 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:58.901365 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.902753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.911573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7486-4f57-4c34-9bbc-c01ed7e08fd3 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:58.914561 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 260/513] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:58.915279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:58.947574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:58.948327 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:58.948616 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:58.948893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:58.949682 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:58.949984 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:58.951405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:58.969056 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 254/514] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:58.969846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.017631 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.021172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a756fe5-4509-4a4d-a5be-be06b8c9748f None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.055751 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.056465 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.056750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.057029 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.057853 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:59.058160 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.059587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.068830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf45fb0-9341-4938-8971-ba46c99a807a None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.076354 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 261/515] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:59.077153 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.088243 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.106899 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.107543 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.107830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.108110 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.173794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76545b-b69d-4153-88fd-b78917eb7ddc None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.175277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.177371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.207690 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.208437 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.208722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.208996 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.215449 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.216957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:49:59.232784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:59.233650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:59.234491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 262/516] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:59.234945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.255864 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.278967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 255/517] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:59.280125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.298965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.342806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a8726-f906-4aa0-92b5-fe55c3188e74 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.377576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.378234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.378535 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.378630 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a4702-bc2f-487e-9f7c-2267f50cd77e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.378820 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.379646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=6baca856645346b39ef5a3ec8f052891) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:59.379965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.381452 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.386779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 263/518] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/role_assignments?user.id=6baca856645346b39ef5a3ec8f052891&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:59.387543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.428010 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.428973 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.429256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.429531 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.487003 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.505817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.507298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.508106 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2ff6f-bc7f-4ebb-b72a-dce937abdfe7 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.527107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.554381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.555070 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.555381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.556335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.557742 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:59.557742 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.559472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.579017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 264/519] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:59.579017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.625297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 256/520] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:49:59.626563 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.693391 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c2b9a-b6b8-47b4-a5e8-c2b587b2d778 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.733744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.734548 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.734834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.735110 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.735374 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bccf5d-ee5f-4524-a28c-e40e226deeac None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.746997 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.748418 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.750464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.752629 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:59.770489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:59.771464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:59.772454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:59.772454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:59.772454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:59.772454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:59.773129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.773784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.774075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.774364 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.774565 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 265/521] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:59.775194 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=a19eb91529e945489e4df71b2e07bd31) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:59.775515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.775811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.777004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.784315 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 257/522] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/role_assignments?user.id=a19eb91529e945489e4df71b2e07bd31&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:49:59.785674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.893093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b576a28-4bcf-4fc1-a76f-69688ef20e46 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.938011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818d02-9e7f-4667-afd8-3ebedd6ac264 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:49:59.940002 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.941099 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.941421 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.941727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.953408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.954970 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:49:59.975127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:49:59.976243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:49:59.977276 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:49:59.977276 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:49:59.977276 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:49:59.977276 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:49:59.980271 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 266/523] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:49:59.982981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:49:59.987295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:49:59.988681 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:49:59.989069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:49:59.989445 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:49:59.990280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:49:59.990692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:49:59.992333 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.009759 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 258/524] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:00.015128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:00.059370 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:00.062401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:00.130124 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6071a91-172a-4041-a698-491cd6b79a3c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:00.136103 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef9d8-b8d2-4db6-9e47-5ea825ef6819 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:00.176586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:00.177269 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:00.177942 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:00.178383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:00.178754 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:00.179054 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:00.179458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:00.180231 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:00.181098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:00.181519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:00.183005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.187883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:00.189542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.199801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 267/525] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:00.200876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:00.210965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:00.211820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:00.212714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:00.215350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 259/526] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:00.220486 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:00.319416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a81d85-19dc-40b0-b8c0-4bf415188153 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:00.327183 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:00.356474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:00.358243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:00.359333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:00.359808 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:00.360321 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:00.360425 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1d3d-94a2-420c-a15f-c1287f4643e2 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:00.367922 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:00.369664 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:00.384883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:00.385744 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:00.386588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:00.389016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 268/527] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:00.394661 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:00.404413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:00.405087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:00.405377 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:00.405661 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:00.406459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:00.406776 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:00.408651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.430273 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 260/528] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:00.431906 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:00.531351 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce50dd5-d041-4973-b759-69d4e0f12dbd None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:00.543521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3bac6-7ca4-46ae-ae82-aaf7c6299803 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:00.577583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:00.578265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:00.578557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:00.578839 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:00.579918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:00.580263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:00.581801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.584614 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1102b2-edcd-4039-a8cd-36c985629ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:00.585561 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1102b2-edcd-4039-a8cd-36c985629ca9 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:00.586044 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1102b2-edcd-4039-a8cd-36c985629ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:00.586517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1102b2-edcd-4039-a8cd-36c985629ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:00.587546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1102b2-edcd-4039-a8cd-36c985629ca9 None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=a159b191ad424a8b9452cd957385b0cc) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:00.588079 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1102b2-edcd-4039-a8cd-36c985629ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:00.589900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1102b2-edcd-4039-a8cd-36c985629ca9 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.595883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 269/529] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:00.601769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:00.612373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 261/530] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:00 2022] GET /identity/v3/role_assignments?user.id=a159b191ad424a8b9452cd957385b0cc&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:00.635466 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:00.716994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65157468-7c7e-4863-902e-31c660db5e05 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:00.757797 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03164eae-1c5f-4e25-a8d6-67a79bd7152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:00.758475 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164eae-1c5f-4e25-a8d6-67a79bd7152a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:00.758764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164eae-1c5f-4e25-a8d6-67a79bd7152a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:00.759046 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164eae-1c5f-4e25-a8d6-67a79bd7152a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:00.759895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164eae-1c5f-4e25-a8d6-67a79bd7152a None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=de739f19f30b4f0ba2c90c96429537d8) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:00.760227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164eae-1c5f-4e25-a8d6-67a79bd7152a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:00.761740 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164eae-1c5f-4e25-a8d6-67a79bd7152a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:00.768585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 270/531] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:00 2022] GET /identity/v3/role_assignments?user.id=de739f19f30b4f0ba2c90c96429537d8&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:01.631827 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84de98f-7e43-461e-98e9-8ca4f7ad471d None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:01.632336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84de98f-7e43-461e-98e9-8ca4f7ad471d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:01.632336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84de98f-7e43-461e-98e9-8ca4f7ad471d None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:01.633938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 262/532] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:01.640516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f650df-d8ec-4df7-bbf0-42d7faee8ee2 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:01.640925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f650df-d8ec-4df7-bbf0-42d7faee8ee2 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:01.641096 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f650df-d8ec-4df7-bbf0-42d7faee8ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:01.658579 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-22f650df-d8ec-4df7-bbf0-42d7faee8ee2 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:01.659857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-22f650df-d8ec-4df7-bbf0-42d7faee8ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:01.730438 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 271/533] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:01.756609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84de98f-7e43-461e-98e9-8ca4f7ad471d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:01.786213 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:01.873513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84de98f-7e43-461e-98e9-8ca4f7ad471d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:01.914020 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2379b38-ff49-4a5d-b20c-4f56a1f9ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:01.914765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379b38-ff49-4a5d-b20c-4f56a1f9ba6a None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:01.915053 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379b38-ff49-4a5d-b20c-4f56a1f9ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:01.915337 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379b38-ff49-4a5d-b20c-4f56a1f9ba6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:01.929073 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2379b38-ff49-4a5d-b20c-4f56a1f9ba6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f2379b38-ff49-4a5d-b20c-4f56a1f9ba6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:01.937640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:01.938597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:01.939437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 263/534] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:01.945790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f650df-d8ec-4df7-bbf0-42d7faee8ee2 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:01.967675 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:02.053935 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f650df-d8ec-4df7-bbf0-42d7faee8ee2 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.063710 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9b941-ccce-455d-934d-600e28c93a5e None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.064005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9b941-ccce-455d-934d-600e28c93a5e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.064335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9b941-ccce-455d-934d-600e28c93a5e None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.069503 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 264/535] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:02.070911 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e27649-6b09-4971-bb14-6dd921451e93 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.071197 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e27649-6b09-4971-bb14-6dd921451e93 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.071476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e27649-6b09-4971-bb14-6dd921451e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.088139 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-51e27649-6b09-4971-bb14-6dd921451e93 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:02.089364 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-51e27649-6b09-4971-bb14-6dd921451e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:02.090812 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.091776 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.092962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.093262 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.094031 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] RBAC: Adding query filter params (name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:02.094354 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.095865 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:02.108124 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 272/536] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:02.113635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.176473 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 265/537] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:50:02.204397 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e27649-6b09-4971-bb14-6dd921451e93 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.219788 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:02.224522 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:02.251342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970509c8-b295-4485-93f2-ee3f8f1f1ccc None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.297731 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.299090 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.299518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.299805 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.315590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.317668 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:02.321106 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e27649-6b09-4971-bb14-6dd921451e93 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:02.338472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:02.339366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:02.340193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:02.340193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:02.340193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:02.340193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:02.340193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 273/538] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:02.345102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.376743 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.378362 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.379190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.379667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.393358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:02.404975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:02.405895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:02.406686 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:02.410390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 266/539] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:02.419762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.474909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8ecc-f1cf-49e9-89ed-74104787e9e3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.511017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:02.525975 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.527082 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.527531 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.528290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.529183 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:02.529642 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.531721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:02.534076 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:02.545392 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafb100-f790-4267-90fa-bf17b2c1aaca None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.550685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 274/540] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:02.555901 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.587463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.588565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.589091 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.589607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.590536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:02.591052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.592720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:02.602085 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 267/541] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:02.609663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.681909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b9ce-4742-44fe-ab67-a77aa282de40 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.720395 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.721548 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.722157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.722696 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.730143 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c3551-2bfc-4f69-a108-7b6a820cf6d9 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.731329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.733155 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:02.757869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:02.758834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:02.759718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:02.766906 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 275/542] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:02.768669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.771421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.772581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.773068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.773538 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.777100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:02.789066 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.790894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:02.811107 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:02.812021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:02.812885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:02.812885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:02.812885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:02.812885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:02.819471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 268/543] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:02.820755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.838158 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:02.901427 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043d56f-6d86-484b-8006-43d3093afa51 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.941472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fef57-2f8d-42c4-a227-f3c567c905f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.942138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fef57-2f8d-42c4-a227-f3c567c905f0 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.942420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fef57-2f8d-42c4-a227-f3c567c905f0 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.942688 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fef57-2f8d-42c4-a227-f3c567c905f0 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.943518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fef57-2f8d-42c4-a227-f3c567c905f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:02.943828 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fef57-2f8d-42c4-a227-f3c567c905f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.944873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb732-a331-4dd1-b1e8-825ee35cdea6 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:02.945296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fef57-2f8d-42c4-a227-f3c567c905f0 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:02.967836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 276/544] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:02.967836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78806-fe82-4959-8b2d-4dafadc0e0c4 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.967836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78806-fe82-4959-8b2d-4dafadc0e0c4 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.967836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78806-fe82-4959-8b2d-4dafadc0e0c4 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.967836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 277/545] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:02.970992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a78806-fe82-4959-8b2d-4dafadc0e0c4 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:02.988562 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa4fd4-ab80-4f74-94e7-0acede5883f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:02.989305 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa4fd4-ab80-4f74-94e7-0acede5883f8 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:02.989599 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa4fd4-ab80-4f74-94e7-0acede5883f8 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:02.989881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa4fd4-ab80-4f74-94e7-0acede5883f8 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:02.990615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa4fd4-ab80-4f74-94e7-0acede5883f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:02.990929 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa4fd4-ab80-4f74-94e7-0acede5883f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:02.992339 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa4fd4-ab80-4f74-94e7-0acede5883f8 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.004407 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 269/546] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:03.005681 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd800f0-7fec-4af1-8022-7fa7de254a1e None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.005968 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd800f0-7fec-4af1-8022-7fa7de254a1e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.006242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd800f0-7fec-4af1-8022-7fa7de254a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.023075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-2cd800f0-7fec-4af1-8022-7fa7de254a1e None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:03.024309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-2cd800f0-7fec-4af1-8022-7fa7de254a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:03.068681 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.084249 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a78806-fe82-4959-8b2d-4dafadc0e0c4 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.091649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 270/547] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:03.092529 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd800f0-7fec-4af1-8022-7fa7de254a1e None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.105406 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.119551 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534459b-bba8-4fa6-b974-d3f5405d15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.120391 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534459b-bba8-4fa6-b974-d3f5405d15e6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.120680 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534459b-bba8-4fa6-b974-d3f5405d15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.120961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534459b-bba8-4fa6-b974-d3f5405d15e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.131125 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534459b-bba8-4fa6-b974-d3f5405d15e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.132597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534459b-bba8-4fa6-b974-d3f5405d15e6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-9534459b-bba8-4fa6-b974-d3f5405d15e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:03.150509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:03.151357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:03.152569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:03.152569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:03.152569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:03.152569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:03.152569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 278/548] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:03.153313 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931435f-59a2-4f38-ab50-dbce7adb409c None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.153601 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931435f-59a2-4f38-ab50-dbce7adb409c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.153880 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931435f-59a2-4f38-ab50-dbce7adb409c None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.155104 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 279/549] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:03.155792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931435f-59a2-4f38-ab50-dbce7adb409c None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.204922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd800f0-7fec-4af1-8022-7fa7de254a1e None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.239394 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51035702-1843-4355-859e-25f744bbc112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.240114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51035702-1843-4355-859e-25f744bbc112 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.240427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51035702-1843-4355-859e-25f744bbc112 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.240706 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51035702-1843-4355-859e-25f744bbc112 None admin] PATH_INFO: `/v3/users/glance` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.247997 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51035702-1843-4355-859e-25f744bbc112 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.249471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51035702-1843-4355-859e-25f744bbc112 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.256549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931435f-59a2-4f38-ab50-dbce7adb409c None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-51035702-1843-4355-859e-25f744bbc112 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:03.263736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:03.264723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 18:50:03.265707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:03.268342 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 271/550] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:03.269898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51035702-1843-4355-859e-25f744bbc112 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.291801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1865d-c2fd-4502-b1c9-f16619f8a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.292637 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1865d-c2fd-4502-b1c9-f16619f8a9bf None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.292924 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1865d-c2fd-4502-b1c9-f16619f8a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.293200 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1865d-c2fd-4502-b1c9-f16619f8a9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.303611 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1865d-c2fd-4502-b1c9-f16619f8a9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-8de1865d-c2fd-4502-b1c9-f16619f8a9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:03.311416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:03.312692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:03.313814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 280/551] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:03.314520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeaa06-0ee5-48b4-aa89-986f071443fc None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.314520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeaa06-0ee5-48b4-aa89-986f071443fc None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.314645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeaa06-0ee5-48b4-aa89-986f071443fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.318116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.330906 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-64aeaa06-0ee5-48b4-aa89-986f071443fc None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:03.332641 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-64aeaa06-0ee5-48b4-aa89-986f071443fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:03.349972 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.379290 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51035702-1843-4355-859e-25f744bbc112 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.398730 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 281/552] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:03.399549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeaa06-0ee5-48b4-aa89-986f071443fc None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.414780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.415458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.415749 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.416027 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.417055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:03.417356 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.418729 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.430798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 272/553] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:03.431590 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.522362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeaa06-0ee5-48b4-aa89-986f071443fc None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.525272 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.529690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266f32d-fbe0-4e35-8e00-40ee8197e0f0 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.556622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.557287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.557569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.557845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.558675 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:03.558982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.560428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.563053 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.563707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.563992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.564298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.565032 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:03.565339 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.566710 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.579397 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 273/554] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:03.579397 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.579716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 282/555] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:03.579716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.591956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.676145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89069012-0492-4726-9a5c-ae2cd8d5b13f None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.678909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78287d-84c9-4cf9-b433-f732b83ad58f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.709431 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.710221 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.710509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.710789 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.712069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.712889 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.713169 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.713448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.717529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.718998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.723846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:03.731574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:03.733058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:03.734052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:03.736514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 274/556] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:03.737270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:03.737835 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:03.739520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:03.740520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 283/557] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:03.741041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.763072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.814977 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:03.844783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fa077-1b0c-4cd5-8312-c91322dfdba3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.848011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e923b3-28a1-4b2e-ae5b-d65f9e307757 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:03.878333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.879226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.879508 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.879780 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.882476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:03.883258 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:03.883545 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:03.883821 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:03.890000 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.891436 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.895079 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:03.896544 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:03.908553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:03.910503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:03.911905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:03.911905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:03.911905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:03.911905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:03.911905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 284/558] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:03.911905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:03.913904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:03.920416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:03.921536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:03.921536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:03.921536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:03.921536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:03.921536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 275/559] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:03.921536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:03.983898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.011909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af518-8544-403e-b69e-2bf7be8b27f9 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.014352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a67864-9548-4ef6-9fe3-656ccefce31e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.035788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.047072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.047734 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.048032 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.048464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.049223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] RBAC: Adding query filter params (name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:04.049536 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.050938 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.051335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.051989 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.052467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.052749 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.053534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:04.053845 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.055298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.058842 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 285/560] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:04.059621 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.067824 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 276/561] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:04.068721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.161893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44e9e-e89e-43e6-b588-2b3682706b73 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.164327 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4c41f-45d7-4e11-9e03-e1e79dcec91f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.192679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.195557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.196387 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.196743 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.197030 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.197754 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:04.197850 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.198067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.198474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.198760 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.199041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.199431 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.199756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:04.200068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.201455 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.212238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 286/562] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:04.217056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.217188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 277/563] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:04.217188 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.264985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.314883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234021ec-f825-4cf2-a8ae-ad4cc01708ca None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.320922 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83b34-7352-4851-a27f-19501baf348d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.348599 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.349488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.349768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.350041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] PATH_INFO: `/v3/projects/f1e951324636416eb0436eea3812cafd/users/6baca856645346b39ef5a3ec8f052891/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.357801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.358623 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.358907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.359185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.364157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e951324636416eb0436eea3812cafd, user_id=6baca856645346b39ef5a3ec8f052891, role_id=5c3ddf575fb24f4aaae8aad1f3e0bb10)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.365634 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.369645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.371320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.379124 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 278/564] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:50:04 2022] PUT /identity/v3/projects/f1e951324636416eb0436eea3812cafd/users/6baca856645346b39ef5a3ec8f052891/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:50:04.379695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:04.390569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:04.391755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:04.392917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:04.392917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:04.392917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:04.392917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:04.392917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 287/565] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:04.392917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.446037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.512445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.513816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef21571-bacf-471f-8d93-303557929d28 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.517230 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5fd93-d2b4-4920-bbcc-cc5faade62a5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.552996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.554676 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.554963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.555242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.565670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.566158 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.566603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.566976 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.567264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.567597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.576284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.577635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:04.582215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:04.583278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:04.584404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:04.584940 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 279/566] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:04.585574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:04.595292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:04.596420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:04.598792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 288/567] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:04.600016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.698055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21aaa3-3a49-4ffb-ac41-a05947b01a8f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.699932 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.707639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75f4e-7efe-405d-880f-dccbf5d84ac3 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.734939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.735690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.735979 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.736295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.737024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:04.737332 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.738734 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.744120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.744898 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.745252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.746063 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.746930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:04.747761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.749295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.750365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 280/568] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:04.753052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.765711 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 289/569] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:04.765711 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.788173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:04.866317 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3c25-1b0c-4908-bb7a-61e42c4a1e29 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.881410 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efc1b-6329-4aa4-a129-e1728972365e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:04.901261 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.902064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.902446 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.902845 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.903776 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:04.904184 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.905731 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.916457 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:04.917501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:04.917792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:04.918081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:04.932987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 281/570] 10.222.0.72 () {56 vars in 1139 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:04.933285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:04.933447 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.933610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:04.949511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:04.950725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:04.951886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 290/571] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:04.952615 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:04.954534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.036128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730dae0-52ba-440e-8c47-616480ddf51b None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.037359 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.062089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe72d-bceb-4e79-b9f1-3b5de80bf046 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.073336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.074233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.074515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.074795 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] PATH_INFO: `/v3/projects/f1e951324636416eb0436eea3812cafd/users/a19eb91529e945489e4df71b2e07bd31/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.089938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e951324636416eb0436eea3812cafd, user_id=a19eb91529e945489e4df71b2e07bd31, role_id=5c3ddf575fb24f4aaae8aad1f3e0bb10)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.091388 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.099370 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.100158 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.100449 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.100724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.116239 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 282/572] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:50:04 2022] PUT /identity/v3/projects/f1e951324636416eb0436eea3812cafd/users/a19eb91529e945489e4df71b2e07bd31/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:50:05.116239 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.116573 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.116573 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:05.135225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:05.136447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:05.137546 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:05.137546 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:05.137546 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:05.137546 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:05.139413 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 291/573] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:05.144262 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.217408 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.256450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a96c7-e854-4e46-ae64-98475edca80e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.270559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f67c9-56bb-4c4e-b84f-832b545b9b2e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.301236 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.301910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.302190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.302458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.303321 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:05.303627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.305093 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.311827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.320157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.320973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.321402 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.321751 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.322896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:05.322896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.324400 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.327224 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 283/574] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:05.332716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.338239 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 292/575] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:05.343891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.450324 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0086-9c41-49fd-984d-f4707ae35a6f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.469391 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce11b6-4324-462f-b666-d384cf331b06 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.480794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.491607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.492515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.492803 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.493085 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.507631 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.509119 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.515876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.516720 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.517009 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.517288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.526333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.527809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:05.532278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:05.533158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:05.534041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:05.534041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:05.534041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:05.534041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:05.536926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 284/576] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:05.543317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:05.544261 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:05.545173 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:05.549336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 293/577] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:05.549635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.550932 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.618647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.671625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dc534-86d3-46ca-8d10-051acc6d3755 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.684630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee7bb-87c6-409a-8785-e00f2b5a9687 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.716856 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.717448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.717739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.718408 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.719302 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:05.719760 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.721279 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.724847 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.725777 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.726289 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.726773 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.727768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:05.728327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.730108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.740170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 285/578] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:05.741249 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.749562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 294/579] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:05.756456 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.797924 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.861981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581889-de48-42cf-a319-659a85912ac2 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.891876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701967-198d-4bd0-a062-2116662dbf9f None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:05.904803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:05.907863 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.908916 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.909350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.910185 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.919120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.921564 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.931649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:05.932706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:05.933129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:05.933512 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] PATH_INFO: `/v3/projects/f1e951324636416eb0436eea3812cafd/users/a159b191ad424a8b9452cd957385b0cc/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:05.940804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:05.942770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:05.943963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:05.946183 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 286/580] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:05.951550 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:05.965392 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e951324636416eb0436eea3812cafd, user_id=a159b191ad424a8b9452cd957385b0cc, role_id=5c3ddf575fb24f4aaae8aad1f3e0bb10)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:05.967588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:05.988309 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 295/581] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:50:05 2022] PUT /identity/v3/projects/f1e951324636416eb0436eea3812cafd/users/a159b191ad424a8b9452cd957385b0cc/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:50:06.079179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:06.084168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f737d88-9733-4b9d-8a34-484a9ca3ef59 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:06.122432 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336d6b8-e8be-41c5-ba0a-7278fe0359d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:06.123523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d6b8-e8be-41c5-ba0a-7278fe0359d5 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:06.124035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d6b8-e8be-41c5-ba0a-7278fe0359d5 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:06.124560 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d6b8-e8be-41c5-ba0a-7278fe0359d5 None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:06.125567 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336d6b8-e8be-41c5-ba0a-7278fe0359d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:06.126091 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336d6b8-e8be-41c5-ba0a-7278fe0359d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:06.127791 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336d6b8-e8be-41c5-ba0a-7278fe0359d5 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:06.143094 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 287/582] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:06.150207 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:06.266252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1012c-aded-414e-87bf-8b3703f79ab6 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:06.307485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390af5a-531a-4d3c-a29e-75b79cce5034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:06.308448 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390af5a-531a-4d3c-a29e-75b79cce5034 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:06.308736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390af5a-531a-4d3c-a29e-75b79cce5034 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:06.309085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390af5a-531a-4d3c-a29e-75b79cce5034 None admin] PATH_INFO: `/v3/projects/f1e951324636416eb0436eea3812cafd/users/de739f19f30b4f0ba2c90c96429537d8/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:06.325891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390af5a-531a-4d3c-a29e-75b79cce5034 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e951324636416eb0436eea3812cafd, user_id=de739f19f30b4f0ba2c90c96429537d8, role_id=5c3ddf575fb24f4aaae8aad1f3e0bb10)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:06.327398 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390af5a-531a-4d3c-a29e-75b79cce5034 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:06.342669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 296/583] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:50:06 2022] PUT /identity/v3/projects/f1e951324636416eb0436eea3812cafd/users/de739f19f30b4f0ba2c90c96429537d8/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:50:06.692737 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a2e0-31df-4db6-be92-7ef448c41c12 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:06.693416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a2e0-31df-4db6-be92-7ef448c41c12 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:06.693916 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a2e0-31df-4db6-be92-7ef448c41c12 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:06.696161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 288/584] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:06.701316 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa33d0-c912-4231-a7d3-2b1759864fc2 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:06.701612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa33d0-c912-4231-a7d3-2b1759864fc2 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:06.701891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa33d0-c912-4231-a7d3-2b1759864fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:06.719571 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-60aa33d0-c912-4231-a7d3-2b1759864fc2 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:06.720818 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-60aa33d0-c912-4231-a7d3-2b1759864fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:06.724316 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:06.797201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 297/585] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:50:06.822293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4a2e0-31df-4db6-be92-7ef448c41c12 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:06.930491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4a2e0-31df-4db6-be92-7ef448c41c12 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:06.976434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:06.977627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:06.977916 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:06.978196 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:06.988792 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:06.996877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:06.997805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:06.998656 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:07.002891 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 289/586] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:07.004327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa33d0-c912-4231-a7d3-2b1759864fc2 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.111501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa33d0-c912-4231-a7d3-2b1759864fc2 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:07.146651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:07.147333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.147624 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.147953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.148732 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] RBAC: Adding query filter params (name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:07.149044 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:07.150404 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:07.159225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 298/587] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:07.165388 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.192592 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:07.279286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2068f-64a8-4849-8ff6-e392ea8ffca6 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:07.316571 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a023-15b6-4b94-9a9f-a711bc6af03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:07.317373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a023-15b6-4b94-9a9f-a711bc6af03f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.317659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a023-15b6-4b94-9a9f-a711bc6af03f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.317935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a023-15b6-4b94-9a9f-a711bc6af03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.328494 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a023-15b6-4b94-9a9f-a711bc6af03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:07.330014 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a023-15b6-4b94-9a9f-a711bc6af03f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-6f80a023-15b6-4b94-9a9f-a711bc6af03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:07.349175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:07.350157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:07.351090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:07.351090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:07.351090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:07.351090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:07.355011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 290/588] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:07.356454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.359342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:07.395406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb05b-3bd0-4681-9ed8-ccdc622b5a2f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.395758 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb05b-3bd0-4681-9ed8-ccdc622b5a2f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.395968 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb05b-3bd0-4681-9ed8-ccdc622b5a2f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.397348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 291/589] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:07.402648 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b5402-acb9-4952-be90-d4b6e9eb4ab7 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.402935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b5402-acb9-4952-be90-d4b6e9eb4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.403212 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b5402-acb9-4952-be90-d4b6e9eb4ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.420407 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-264b5402-acb9-4952-be90-d4b6e9eb4ab7 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:07.421622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-264b5402-acb9-4952-be90-d4b6e9eb4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:07.470994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d79a6a-aca3-4336-908a-8983bc0b4b5c None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:07.508297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 292/590] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:07.518161 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:07.519295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.519804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.520324 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.521255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:07.521802 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:07.523379 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:07.532406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b5402-acb9-4952-be90-d4b6e9eb4ab7 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.535926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:07.547464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 299/591] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:07.552016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.640051 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:07.656149 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b5402-acb9-4952-be90-d4b6e9eb4ab7 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:07.693707 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f022-d4cd-46fa-984f-0963fe4a3a84 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:07.699352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:07.700386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.700839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.701714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.716118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:07.727430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:07.728702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:07.729708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:07.735094 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 293/592] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:07.736463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.740229 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:07.741041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.742138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.742138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.749823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:07.751288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:07.766651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:07.767823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:07.768964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:07.772343 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 300/593] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:07.774308 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.817071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:07.868693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d2537-8d2e-4659-968b-2729f5aaeaeb None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:07.886527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109b84-c244-4bbd-a936-8d1235c4dea9 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:07.911310 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:07.913046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:07.914900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.915254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.915541 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.916583 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:07.916902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:07.919070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:07.927593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:07.928512 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:07.929027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:07.929469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:07.930527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:07.931005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:07.932660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:07.934687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 294/594] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:07.936048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:07.960414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 301/595] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:07.961585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.056490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291e259-448b-4641-a760-e009b7c44244 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.077158 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a6e3-2111-42d3-88e9-4d35235f96ff None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.082992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.096812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.098407 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.098852 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.099381 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.111951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.114247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.115066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.115780 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.116075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.116381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:08.134168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:08.135307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:08.136403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:08.136403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:08.136403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:08.136403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:08.138295 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 295/596] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:08.146806 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.183189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.204180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.205543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.277114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7075754-582a-4645-8a7a-d3063e131c2c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.322909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 302/597] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:50:08.323136 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.323136 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.323136 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.323136 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.323431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:08.323431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.324845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.325413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.339434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 296/598] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:08.346745 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.397247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.415729 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.438339 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c014-be98-4ba4-8ac1-493028326136 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.472552 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9336-06dc-4e7e-ba0b-d417926bf336 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.475005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f31cb6-3d49-4499-8854-55d6bcee6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.475815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f31cb6-3d49-4499-8854-55d6bcee6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.476101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f31cb6-3d49-4499-8854-55d6bcee6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.476405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f31cb6-3d49-4499-8854-55d6bcee6ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.487491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f31cb6-3d49-4499-8854-55d6bcee6ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.489471 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f31cb6-3d49-4499-8854-55d6bcee6ad8 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.508444 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526f74-229a-49d7-9aa7-2015ab4863cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.509274 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526f74-229a-49d7-9aa7-2015ab4863cc None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.509558 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526f74-229a-49d7-9aa7-2015ab4863cc None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.509836 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526f74-229a-49d7-9aa7-2015ab4863cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-71f31cb6-3d49-4499-8854-55d6bcee6ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:08.510253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:08.511134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:08.512132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:08.512132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:08.512132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:08.512132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:08.512414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 303/599] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:08.513866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7c311-2475-461d-b431-05a5c0f87ec5 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.514163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7c311-2475-461d-b431-05a5c0f87ec5 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.514454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7c311-2475-461d-b431-05a5c0f87ec5 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.520016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 304/600] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:08.520016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7c311-2475-461d-b431-05a5c0f87ec5 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.527682 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1526f74-229a-49d7-9aa7-2015ab4863cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.529333 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1526f74-229a-49d7-9aa7-2015ab4863cc None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f1526f74-229a-49d7-9aa7-2015ab4863cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:08.546152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:08.547454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 18:50:08.548621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:08.553087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 297/601] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:08.553087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245e9d-ecaa-4fdd-8bf9-cacd76ae43b2 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.553087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245e9d-ecaa-4fdd-8bf9-cacd76ae43b2 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.553087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245e9d-ecaa-4fdd-8bf9-cacd76ae43b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.572058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-a6245e9d-ecaa-4fdd-8bf9-cacd76ae43b2 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:08.573942 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-a6245e9d-ecaa-4fdd-8bf9-cacd76ae43b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:08.645832 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 298/602] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:08.646800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7c311-2475-461d-b431-05a5c0f87ec5 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.657121 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6245e9d-ecaa-4fdd-8bf9-cacd76ae43b2 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.685952 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.690155 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.692182 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1000c-bbfb-4907-bdbd-5c98959a1418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.692940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1000c-bbfb-4907-bdbd-5c98959a1418 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.693231 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1000c-bbfb-4907-bdbd-5c98959a1418 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.693514 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1000c-bbfb-4907-bdbd-5c98959a1418 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.694241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1000c-bbfb-4907-bdbd-5c98959a1418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:08.694554 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1000c-bbfb-4907-bdbd-5c98959a1418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.695981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1000c-bbfb-4907-bdbd-5c98959a1418 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.707249 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 305/603] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:08.708520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ae85-e057-4159-bed4-972c5f47b568 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.708813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ae85-e057-4159-bed4-972c5f47b568 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.709182 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ae85-e057-4159-bed4-972c5f47b568 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.710458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 306/604] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:08.710998 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ae85-e057-4159-bed4-972c5f47b568 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.765201 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6245e9d-ecaa-4fdd-8bf9-cacd76ae43b2 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.799325 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.799985 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.800311 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.801178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.802002 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:08.802311 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.803729 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.816331 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ae85-e057-4159-bed4-972c5f47b568 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.820336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 299/605] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:08.821115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.852349 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e28a-d157-4303-873e-80d75a26d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.853168 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e28a-d157-4303-873e-80d75a26d8fe None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.853434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e28a-d157-4303-873e-80d75a26d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.853713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e28a-d157-4303-873e-80d75a26d8fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.864260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e28a-d157-4303-873e-80d75a26d8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-be53e28a-d157-4303-873e-80d75a26d8fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:08.872060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:08.873075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:08.873933 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 307/606] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:08.874633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329a5a-462b-4dc9-b035-091b2ce9d154 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.874712 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329a5a-462b-4dc9-b035-091b2ce9d154 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.874951 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329a5a-462b-4dc9-b035-091b2ce9d154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.890723 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-e7329a5a-462b-4dc9-b035-091b2ce9d154 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:08.891914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-e7329a5a-462b-4dc9-b035-091b2ce9d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:08.906974 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.923765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f43b-4485-4a84-8fc1-537d9bed5495 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:08.939077 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:08.958433 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:08.958583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 308/607] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:08.959217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:08.959505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:08.959790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:08.965060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7329a5a-462b-4dc9-b035-091b2ce9d154 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:08.966492 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:08.969410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:08.986352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:08.987490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:08.989100 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 300/608] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:08.989662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.069650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7329a5a-462b-4dc9-b035-091b2ce9d154 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.088559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca65d3-08c3-4b55-a6a9-4a3b514aac45 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.102734 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.103374 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.103656 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.103928 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.121548 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.122206 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.122493 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.122768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.123504 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:09.123812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.125228 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.133128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 301/609] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:09.133897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.142577 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.153357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.172569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.173976 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.235369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762ab7-b2bf-4639-9da3-20b259c7f581 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.268619 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.269942 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.270202 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 309/610] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:50:09.270307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.270482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.271038 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.281525 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:09.289926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:09.290921 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:09.292019 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 302/611] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:09.292839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.355098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.357766 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.376555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296219-5562-4a96-afe0-414878bd7991 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.390388 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa374eb-b976-4f0a-816b-f7e994abda87 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.411043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.411704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.411989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.412309 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.413107 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:09.413425 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.414862 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.423878 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.424676 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.424965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.425245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.426353 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 310/612] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:09.427137 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.435992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.437475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:09.454514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:09.455435 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:09.456386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:09.456386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:09.456386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:09.456386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:09.456386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 303/613] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:09.458046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.524757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670576ca-9f73-43ff-9dcd-8a5fc77b123d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.554920 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1970808-9345-4d5e-8bf1-62661ebcd4c9 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.557437 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.558230 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.558516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.558797 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.570619 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.572077 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.573788 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.574383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:09.590524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:09.591455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:09.592888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:09.592888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:09.592888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:09.592888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:09.593198 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.593298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 311/614] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:09.593387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.593387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.593543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.593651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.593651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:09.593651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.595027 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.603077 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 304/615] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:09.603858 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.694734 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687111b3-8dbb-4f7e-b3be-330658e9df85 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.702370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04063-7873-4e41-848e-d9b92fc4cb19 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.728703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.729366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.729646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.729920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.730739 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=6baca856645346b39ef5a3ec8f052891) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:09.731049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.732500 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.737879 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.738966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 312/616] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/role_assignments?user.id=6baca856645346b39ef5a3ec8f052891&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:09.739087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.739348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.739625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.739777 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.740383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:09.740694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.742040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.754787 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 305/617] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:09.757053 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.810551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.817142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:09.870473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472461-1dbc-4556-9b94-4eb733420344 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.874660 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffdb83-7f64-4ea4-9a25-9de517e6c94c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:09.912099 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.912692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:09.913045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.913121 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.913303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:09.913395 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.913513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:09.913777 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:09.914085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:09.914400 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.915784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.925744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:09.927175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:09.929787 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 313/618] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:09.930621 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:09.950304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:09.951219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:09.952586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:09.952586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:09.952586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:09.952586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:09.952586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 306/619] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:09.952586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.043060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8958fe0-5dc4-4947-98d3-abbf19716224 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.060892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.064151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.075547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f5b4-03fb-408f-9818-f9d463f882da None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.078867 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.079725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.080060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.080368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.088339 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.089789 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:10.105061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:10.105994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 314/620] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:10.107018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.119225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.120458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.120766 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.121046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.128750 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.130187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:10.145235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:10.146148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 307/621] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:10.147727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.223432 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b437e-eec1-42b4-87a6-f525ecdaab78 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.253790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420eea-3ba9-4726-998e-6a04f974ae3f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.259806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.260504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.260792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.261096 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.261827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:10.262142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.263515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.281485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 315/622] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:10.282649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.301096 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.301765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.302049 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.302321 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.303151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:10.303462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.304965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.328513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 308/623] 10.222.0.72 () {56 vars in 1139 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:10.328513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.336747 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.340240 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.404125 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd274be8-81c8-432f-8fe8-5fb17cafe173 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.435297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155720ab-7629-4a6d-a487-6a6dd29c9eee None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.440737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.442171 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.442611 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.443051 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.443993 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:10.444501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.446232 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.464562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 316/624] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:10.465695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.471798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.472765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.473154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.473581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.482526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.484076 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:10.498952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:10.500126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:50:10.501345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:10.502014 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 309/625] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:10.505126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.572353 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.576513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888af9e-3bc1-45d9-a4f1-ceb6f9ea2097 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.580274 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.612881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7453-f00b-45ce-a69d-2d83e05b41d8 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.614497 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.615264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.615658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.616066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.648820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.649473 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.649756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.650036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.650854 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=a19eb91529e945489e4df71b2e07bd31) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:10.651176 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.652624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.658562 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 310/626] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/role_assignments?user.id=a19eb91529e945489e4df71b2e07bd31&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:10.659335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.716575 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.719125 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.803560 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edea3bc-5989-4484-8da7-002b5aad50eb None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:10.845169 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:10.846159 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:10.846452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:10.846735 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:10.847867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:10.848187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:10.850054 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:10.852822 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.854496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:10.860250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 317/627] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 18:50:10.866667 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.872606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 311/628] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:10.880725 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:10.999857 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdccc6-92a0-4247-a55f-f334aaa76f3a None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.002567 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78318a1-67cc-43b7-bb59-8997be59e49d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.051177 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.052098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.052265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.052461 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.052712 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.052895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.053183 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.053461 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.065612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.068041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:11.093889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:11.094854 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:11.095815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:11.095815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:11.095815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:11.095815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:11.100342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 318/629] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:11.101767 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.124086 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:11.138542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.140465 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.162746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:11.215124 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bf3dc-798d-4e30-a7fc-b14d00b7ff3f None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.252861 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.253559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.253909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.254191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.255107 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:11.255260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.255413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 312/630] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:50:11.260253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.261424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.268907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 319/631] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:11.275238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.384047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:11.390803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1b0a7-c184-4fc0-95f6-d57597fdb592 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.396598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd1a2-875d-4ad8-99c1-3ed82eb2c3b3 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.403923 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:11.433338 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.434526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.435021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.435519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.437879 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.438873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.439075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.439344 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.443944 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.445646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.450470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.451911 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:11.462260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:11.463134 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:11.464012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:11.466451 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 320/632] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:11.474048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:11.476343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:11.477217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:11.478154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:11.478154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:11.478154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:11.478154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:11.478154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 313/633] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:11.484170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.595051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275681ed-5af6-40f9-aca1-82b8a2bb9410 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.611494 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492852-8daa-47cf-9ff7-946e24cda82b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.643642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.645484 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.646063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.646540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.647535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:11.647962 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.648265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.648780 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.649159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.649507 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.650366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:11.650568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.650798 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.652364 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.671653 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 314/634] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:11.673886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 321/635] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:11.674831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.676115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.681447 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:11.716077 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:11.796881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9770ff-6b9e-430d-ba9d-6aaa21159b47 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.805770 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feec28f-9ed6-4488-8914-3f9900a828fc None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:11.832829 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.834227 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.834740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.835117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.843583 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.845144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:11.845284 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.846245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:11.846702 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:11.847252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:11.848373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=a159b191ad424a8b9452cd957385b0cc) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:11.848840 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:11.850569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:11.857503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 322/636] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/role_assignments?user.id=a159b191ad424a8b9452cd957385b0cc&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:11.864640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:11.865801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:11.866719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:11.868979 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 315/637] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:11.875056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:11.988002 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:11.996781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a057-3725-41f3-b687-aa0b5e10d8ba None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:12.039608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2b20a-0ca5-4fdd-94cb-89d647854067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:12.040299 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2b20a-0ca5-4fdd-94cb-89d647854067 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.040593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2b20a-0ca5-4fdd-94cb-89d647854067 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.040872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2b20a-0ca5-4fdd-94cb-89d647854067 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.041948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2b20a-0ca5-4fdd-94cb-89d647854067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:12.042260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2b20a-0ca5-4fdd-94cb-89d647854067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:12.043722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2b20a-0ca5-4fdd-94cb-89d647854067 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:12.058124 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 323/638] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:12.063990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:12.087969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c7cd0-56d3-4945-b4da-bd5ef1796815 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.088180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c7cd0-56d3-4945-b4da-bd5ef1796815 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.088767 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c7cd0-56d3-4945-b4da-bd5ef1796815 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.090140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 324/639] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:12.096040 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f8b6-0e73-493b-977f-c30c03edd9c5 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.096290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f8b6-0e73-493b-977f-c30c03edd9c5 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.096593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f8b6-0e73-493b-977f-c30c03edd9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.115951 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-eba3f8b6-0e73-493b-977f-c30c03edd9c5 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:12.117227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-eba3f8b6-0e73-493b-977f-c30c03edd9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:12.151259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:12.190872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8c3f4-6d80-4f0b-a089-cd80a92403a4 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:12.193781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 325/640] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:12.224755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f8b6-0e73-493b-977f-c30c03edd9c5 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:12.231519 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:12.232254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.232599 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.232965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.233806 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=de739f19f30b4f0ba2c90c96429537d8) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:12.234119 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:12.235666 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:12.243037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 316/641] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:12 2022] GET /identity/v3/role_assignments?user.id=de739f19f30b4f0ba2c90c96429537d8&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:12.337850 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:12.355981 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f8b6-0e73-493b-977f-c30c03edd9c5 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:12.393978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:12.394929 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.395212 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.395489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.407545 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:12.415671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:12.417058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:12.417978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 326/642] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:12.423382 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:12.528957 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d344c0b-8159-400e-8409-1c460330bd47 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:12.562372 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:12.570849 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:12.571530 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.571814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.572090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.572871 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:12.573179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:12.574567 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:12.583672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 317/643] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:12.589081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:12.698955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a5d23-2cfb-4df9-aabd-091f422a098d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:12.734405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:12.735213 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.735501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.735781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.748527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:12.750016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:12.752837 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:12.769162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:12.770091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:12.770992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:12.770992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:12.770992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:12.770992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:12.770992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 327/644] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:12.776148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:12.881168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f55a-71ed-4dce-abec-3d3b08a7ef7c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:12.920687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04f4aa-68c4-44f3-955a-7c391dfacf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:12.921361 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f4aa-68c4-44f3-955a-7c391dfacf9c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:12.921647 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f4aa-68c4-44f3-955a-7c391dfacf9c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:12.921928 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f4aa-68c4-44f3-955a-7c391dfacf9c None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:12.922653 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04f4aa-68c4-44f3-955a-7c391dfacf9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:12.922965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04f4aa-68c4-44f3-955a-7c391dfacf9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:12.924373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04f4aa-68c4-44f3-955a-7c391dfacf9c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:12.937762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 318/645] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:12.942843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:13.062234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6e04-702c-4732-b07d-f8cc0f5d348e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:13.098760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:13.099905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.100531 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.101015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] PATH_INFO: `/v3/users/nova` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.109258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:13.110997 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:13.120261 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a95d-7c59-42b7-a390-59f9840a3610 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.120796 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a95d-7c59-42b7-a390-59f9840a3610 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.120796 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a95d-7c59-42b7-a390-59f9840a3610 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.123446 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 319/646] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:13.127201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:13.128145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:13.129172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:13.129718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4eba9-297a-4261-babe-84ae5a116f41 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.129718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4eba9-297a-4261-babe-84ae5a116f41 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.129718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4eba9-297a-4261-babe-84ae5a116f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.131987 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 328/647] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Jul 14 18:50:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:13.137137 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:13.146480 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-27a4eba9-297a-4261-babe-84ae5a116f41 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:13.148165 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-27a4eba9-297a-4261-babe-84ae5a116f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:13.202214 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:13.214316 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:13.256369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 320/648] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 18:50:13.268411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b648ba-1bfe-4e30-b2c8-50d9bcc2a72d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:13.279634 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4eba9-297a-4261-babe-84ae5a116f41 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:13.307306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:13.307988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.308317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.308602 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.309443 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:13.309756 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:13.311256 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:13.330382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 329/649] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Jul 14 18:50:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:13.336455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:13.413270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4eba9-297a-4261-babe-84ae5a116f41 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:13.453848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:13.455318 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.455613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.455898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] PATH_INFO: `/v3/services/image` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.456644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:13.458058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372adca-26a1-4c33-9f76-50f8af6e8402 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:13.458687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:13.474182 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:13.478413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:13.480371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:13.482170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:13.492225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 321/650] 10.222.0.72 () {56 vars in 1105 bytes} [Thu Jul 14 18:50:13 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:13.492225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:13.511401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:13.512816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.514255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.514255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.537822 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:13.599827 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4030afe-4b7e-4111-92d8-d37540cb3627 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:13.616109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:13.617890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:13.641346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:13.642178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.642463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.643040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.643758 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] RBAC: Adding query filter params (name=image) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:13.644690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:13.646694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:13.652990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 322/651] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:13.659529 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:13.767485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 330/652] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 18:50:13.775323 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:13.787016 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c13a-9d88-43f7-a5fd-eedfa7faf633 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:13.795518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:13.797576 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:13.826889 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:13.827611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.827900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.828174 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.828934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] RBAC: Adding query filter params (type=image) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:13.829309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:13.830771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:13.837151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 323/653] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:13.904827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d0483-4401-4a25-b04d-5932564e5c1d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:13.950635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:13.951454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:13.951741 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:13.952023 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:13.964133 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:13.965634 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:13.986067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:13.988785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:13.990919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:13.990919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:13.990919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:13.990919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:13.994386 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 331/654] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:13.994602 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.103350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2774-b583-4a84-b2cf-c809ec44a242 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:14.138691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150cdf-4715-46bd-8fc3-31ad7950375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:14.139488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150cdf-4715-46bd-8fc3-31ad7950375a None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.139650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150cdf-4715-46bd-8fc3-31ad7950375a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.139885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150cdf-4715-46bd-8fc3-31ad7950375a None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.140655 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150cdf-4715-46bd-8fc3-31ad7950375a None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:14.140971 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150cdf-4715-46bd-8fc3-31ad7950375a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:14.142363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150cdf-4715-46bd-8fc3-31ad7950375a None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:14.158744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 324/655] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:14.160726 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.236098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:14.273695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233738-0892-4080-b8bc-51c5f28d6555 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:14.311165 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4965ee-5438-4bbf-9102-751a9dc747b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:14.311965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4965ee-5438-4bbf-9102-751a9dc747b7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.312281 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4965ee-5438-4bbf-9102-751a9dc747b7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.312567 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4965ee-5438-4bbf-9102-751a9dc747b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.319510 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4965ee-5438-4bbf-9102-751a9dc747b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:14.321002 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4965ee-5438-4bbf-9102-751a9dc747b7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-de4965ee-5438-4bbf-9102-751a9dc747b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:14.335407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:14.337790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:14.339883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:14.340925 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ec83-6407-4b20-8043-00e390f07151 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.340925 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ec83-6407-4b20-8043-00e390f07151 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.340925 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ec83-6407-4b20-8043-00e390f07151 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.340925 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 325/657] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:14.341523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 332/657] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:14.344823 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ec83-6407-4b20-8043-00e390f07151 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.345769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542e38-c04b-48a7-9c2e-0cf38dd3bd44 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.346061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542e38-c04b-48a7-9c2e-0cf38dd3bd44 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.346342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542e38-c04b-48a7-9c2e-0cf38dd3bd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.366459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-61542e38-c04b-48a7-9c2e-0cf38dd3bd44 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:14.367642 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-61542e38-c04b-48a7-9c2e-0cf38dd3bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:14.388035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:14.468287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 333/658] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:14.479893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ec83-6407-4b20-8043-00e390f07151 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:14.491251 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61542e38-c04b-48a7-9c2e-0cf38dd3bd44 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.523123 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:14.523945 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.524253 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.524842 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.526033 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:14.526356 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:14.528338 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:14.543563 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 326/659] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:14.549372 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.565840 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:14.626613 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61542e38-c04b-48a7-9c2e-0cf38dd3bd44 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:14.652101 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:14.663721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be824f57-677a-4eb4-bf68-6e9be9be1680 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:14.681375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09220d0-b33d-4966-b0f0-3cbf439262ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:14.682313 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09220d0-b33d-4966-b0f0-3cbf439262ab None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.682608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09220d0-b33d-4966-b0f0-3cbf439262ab None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.683154 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09220d0-b33d-4966-b0f0-3cbf439262ab None admin] PATH_INFO: `/v3/services/network` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.684189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09220d0-b33d-4966-b0f0-3cbf439262ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:14.685616 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09220d0-b33d-4966-b0f0-3cbf439262ab None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:14.702742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4aef8-98c5-4d39-a935-d85f4908afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:14.703400 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4aef8-98c5-4d39-a935-d85f4908afb0 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.703687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4aef8-98c5-4d39-a935-d85f4908afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.703969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4aef8-98c5-4d39-a935-d85f4908afb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.704856 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4aef8-98c5-4d39-a935-d85f4908afb0 None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=6baca856645346b39ef5a3ec8f052891) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-f09220d0-b33d-4966-b0f0-3cbf439262ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:14.705108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:14.707806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:14.709834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:14.711788 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4aef8-98c5-4d39-a935-d85f4908afb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:14.711788 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4aef8-98c5-4d39-a935-d85f4908afb0 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:14.712073 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 334/660] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:14 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:14.713768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8c28-5b08-44f8-a27a-7ff766966a8b None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.714230 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8c28-5b08-44f8-a27a-7ff766966a8b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.714513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8c28-5b08-44f8-a27a-7ff766966a8b None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.719699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 335/661] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:14.719699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b8c28-5b08-44f8-a27a-7ff766966a8b None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.724187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 327/662] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:14 2022] GET /identity/v3/role_assignments?user.id=6baca856645346b39ef5a3ec8f052891&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:14.724187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a9a6-9369-4cee-b13b-37384153ba0c None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.724187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a9a6-9369-4cee-b13b-37384153ba0c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.724187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a9a6-9369-4cee-b13b-37384153ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.741492 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-cad7a9a6-9369-4cee-b13b-37384153ba0c None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:14.743108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-cad7a9a6-9369-4cee-b13b-37384153ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:14.828619 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 328/663] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:14.834593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b8c28-5b08-44f8-a27a-7ff766966a8b None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:14.846330 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a9a6-9369-4cee-b13b-37384153ba0c None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.857974 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:14.872666 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:14.873447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:14.873894 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:14.874150 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:14.874957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] RBAC: Adding query filter params (name=network) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:14.875618 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:14.876944 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:14.882904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 336/664] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:14.888565 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:14.955537 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:14.969097 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a9a6-9369-4cee-b13b-37384153ba0c None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:15.006795 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:15.007981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:15.008567 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:15.009052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:15.009876 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:15.011412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:15.024600 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:15.025565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:15.026390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:15.027699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c944959-386d-492a-8e32-89c71665b33e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:15.033943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 329/665] 10.222.0.72 () {56 vars in 1129 bytes} [Thu Jul 14 18:50:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:15.035555 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:15.072633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:15.073918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:15.074420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:15.074918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:15.076975 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] RBAC: Adding query filter params (type=network) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:15.077389 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:15.080789 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:15.096466 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 337/666] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:15.159485 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec834-76a9-4471-9759-58ce3acb15c7 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:15.203225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e36e2-d56c-4e58-9402-280c3f2a9006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:15.204326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e36e2-d56c-4e58-9402-280c3f2a9006 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:15.204816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e36e2-d56c-4e58-9402-280c3f2a9006 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:15.205292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e36e2-d56c-4e58-9402-280c3f2a9006 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:15.206207 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e36e2-d56c-4e58-9402-280c3f2a9006 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:15.207277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e36e2-d56c-4e58-9402-280c3f2a9006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:15.209176 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e36e2-d56c-4e58-9402-280c3f2a9006 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:15.215115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 330/667] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Jul 14 18:50:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:15.220704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:15.287132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:15.342515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9392-08b5-4508-8118-07bcf4817618 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:15.376756 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf72c-9368-4acc-b523-3a067cf74c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:15.377419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf72c-9368-4acc-b523-3a067cf74c6b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:15.377701 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf72c-9368-4acc-b523-3a067cf74c6b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:15.377976 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf72c-9368-4acc-b523-3a067cf74c6b None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:15.378706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf72c-9368-4acc-b523-3a067cf74c6b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:15.379014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf72c-9368-4acc-b523-3a067cf74c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:15.380394 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf72c-9368-4acc-b523-3a067cf74c6b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:15.385202 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 338/668] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Jul 14 18:50:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:16.195786 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f2bce-adba-4dfe-8647-2dccf25b8cf8 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:16.196838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f2bce-adba-4dfe-8647-2dccf25b8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:16.197349 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f2bce-adba-4dfe-8647-2dccf25b8cf8 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:16.199145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 331/669] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:16.204412 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42cfcb-0a40-48e9-9149-dfb774a3b663 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:16.204940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42cfcb-0a40-48e9-9149-dfb774a3b663 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:16.205424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42cfcb-0a40-48e9-9149-dfb774a3b663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:16.222270 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-5d42cfcb-0a40-48e9-9149-dfb774a3b663 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:16.224139 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-5d42cfcb-0a40-48e9-9149-dfb774a3b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:16.294577 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 339/670] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:16.318517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f2bce-adba-4dfe-8647-2dccf25b8cf8 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:16.335173 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:16.427216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f2bce-adba-4dfe-8647-2dccf25b8cf8 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:16.461701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1d02a-7cbb-4bb5-a960-7051db1a61e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:16.462283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1d02a-7cbb-4bb5-a960-7051db1a61e1 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:16.462565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1d02a-7cbb-4bb5-a960-7051db1a61e1 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:16.462838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1d02a-7cbb-4bb5-a960-7051db1a61e1 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:16.463560 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1d02a-7cbb-4bb5-a960-7051db1a61e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:16.465008 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1d02a-7cbb-4bb5-a960-7051db1a61e1 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:16.483142 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 332/671] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:50:16 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:50:17.044660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f05b1b-097a-4f69-ac9b-f15093374914 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.045386 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f05b1b-097a-4f69-ac9b-f15093374914 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.045903 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f05b1b-097a-4f69-ac9b-f15093374914 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.047749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 340/672] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:17.054158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4607e-4c84-4ce4-8316-749c65ef8539 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.054716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4607e-4c84-4ce4-8316-749c65ef8539 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.055200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4607e-4c84-4ce4-8316-749c65ef8539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.072732 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-d1e4607e-4c84-4ce4-8316-749c65ef8539 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:17.074271 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-d1e4607e-4c84-4ce4-8316-749c65ef8539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:17.152124 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:17.165788 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 333/673] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:17 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:17.186019 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f05b1b-097a-4f69-ac9b-f15093374914 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:17.232505 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:17.295945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f05b1b-097a-4f69-ac9b-f15093374914 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:17.333169 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8071d5-854d-4d5b-a418-173e0f0514ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:17.333969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8071d5-854d-4d5b-a418-173e0f0514ed None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.334250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8071d5-854d-4d5b-a418-173e0f0514ed None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.334527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8071d5-854d-4d5b-a418-173e0f0514ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.344969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8071d5-854d-4d5b-a418-173e0f0514ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-8f8071d5-854d-4d5b-a418-173e0f0514ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:17.353201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:17.354120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:17.354968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 341/674] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:17.361626 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4607e-4c84-4ce4-8316-749c65ef8539 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:17.442953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228eb9f-ffc8-4e30-810c-502378ee7cfb None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.443599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228eb9f-ffc8-4e30-810c-502378ee7cfb None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.444095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228eb9f-ffc8-4e30-810c-502378ee7cfb None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.445934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 342/675] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:17.450954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833013-b48b-4f65-b9d9-ed2734e642f0 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.451460 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833013-b48b-4f65-b9d9-ed2734e642f0 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.451955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a833013-b48b-4f65-b9d9-ed2734e642f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.469488 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-7a833013-b48b-4f65-b9d9-ed2734e642f0 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:17.470993 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7a833013-b48b-4f65-b9d9-ed2734e642f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:17.471199 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4607e-4c84-4ce4-8316-749c65ef8539 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:17.507902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:17.508847 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.509308 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.509739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.510650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:17.511110 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:17.512824 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:17.527451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 334/676] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:17.529104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:17.550166 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 343/677] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:17 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:17.574229 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833013-b48b-4f65-b9d9-ed2734e642f0 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:17.603641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:17.612595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:17.647126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9109-6b39-4c5d-a685-bf72288aabfe None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:17.682724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a833013-b48b-4f65-b9d9-ed2734e642f0 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:17.685607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae996c2-076c-46dd-a27a-fd08288371ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:17.686593 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae996c2-076c-46dd-a27a-fd08288371ae None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.687071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae996c2-076c-46dd-a27a-fd08288371ae None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.687529 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae996c2-076c-46dd-a27a-fd08288371ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.699663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae996c2-076c-46dd-a27a-fd08288371ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:17.701471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae996c2-076c-46dd-a27a-fd08288371ae None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:17.720075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44ce60-b1d5-409d-8cab-2a406e3a4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-6ae996c2-076c-46dd-a27a-fd08288371ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:17.720293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:17.721147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:17.722031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:17.722031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:17.722031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:17.722031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:17.722920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ce60-b1d5-409d-8cab-2a406e3a4eca None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.722920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ce60-b1d5-409d-8cab-2a406e3a4eca None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.722920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ce60-b1d5-409d-8cab-2a406e3a4eca None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.722920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44ce60-b1d5-409d-8cab-2a406e3a4eca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:17.723948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44ce60-b1d5-409d-8cab-2a406e3a4eca None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:17.724338 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 335/678] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:17.725892 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799f609-6640-4bb0-b94f-e350e32e9a60 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.726527 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799f609-6640-4bb0-b94f-e350e32e9a60 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.727030 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799f609-6640-4bb0-b94f-e350e32e9a60 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.728901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 336/679] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:17.733138 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799f609-6640-4bb0-b94f-e350e32e9a60 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:17.741278 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 344/680] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:50:17 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:50:17.742373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb655b4-3396-4eaf-950b-35999057e3c6 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.742662 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb655b4-3396-4eaf-950b-35999057e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.742941 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb655b4-3396-4eaf-950b-35999057e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.760587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-afb655b4-3396-4eaf-950b-35999057e3c6 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:17.761833 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-afb655b4-3396-4eaf-950b-35999057e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:17.849590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 345/681] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:17 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 18:50:17.869054 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb655b4-3396-4eaf-950b-35999057e3c6 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:17.889599 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799f609-6640-4bb0-b94f-e350e32e9a60 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:17.891092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:17.912319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:17.940059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:17.940853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:17.941668 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:17.941949 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:17.942676 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:17.942984 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:17.944513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:17.962413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 337/682] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:17.963674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:17.997724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb655b4-3396-4eaf-950b-35999057e3c6 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:18.044890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:18.047492 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.047792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.048088 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.048872 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:18.050268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:18.067502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 346/683] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:50:17 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:50:18.088780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476fca0-7a7d-42bc-9f00-1b397d3fd054 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:18.136999 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:18.138369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.138857 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.139326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.149687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:18.151647 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:18.168692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:18.169761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:18.170693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:18.173678 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 338/684] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Jul 14 18:50:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:18.182396 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:18.267983 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:18.296935 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b53e1a-f884-4fc3-9adb-dfec3a3a3c63 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:18.333684 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:18.334366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.334659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.334940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.335793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:18.336108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:18.337591 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:18.360318 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 347/685] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Jul 14 18:50:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:18.362673 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:18.396761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:18.473128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482da73-072f-4e6d-bd6f-23b2dd31e4ae None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:18.510028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:18.510812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.511096 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.511370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.522692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:18.524140 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:18.542440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:18.543354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:18.544746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:18.544746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:18.544746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:18.544746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:18.544746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 339/686] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:18.551627 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:18.676423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd93e6-2147-4101-974d-538477651caa None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:18.712140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db475f-0965-4c15-828f-c89d2093071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:18.713219 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db475f-0965-4c15-828f-c89d2093071b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.713715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db475f-0965-4c15-828f-c89d2093071b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.714213 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db475f-0965-4c15-828f-c89d2093071b None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.715286 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db475f-0965-4c15-828f-c89d2093071b None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:18.715815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db475f-0965-4c15-828f-c89d2093071b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:18.717422 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db475f-0965-4c15-828f-c89d2093071b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:18.720083 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:18.734653 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 348/687] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:18.737265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:18.784582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc0f34-22a6-4889-96ad-edf50e2df862 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.785433 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc0f34-22a6-4889-96ad-edf50e2df862 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.785724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc0f34-22a6-4889-96ad-edf50e2df862 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.787092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 349/688] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:18.792447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80e2d-85a8-4c70-8073-8ac5dcd85453 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.792741 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80e2d-85a8-4c70-8073-8ac5dcd85453 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.793082 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be80e2d-85a8-4c70-8073-8ac5dcd85453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.811766 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-9be80e2d-85a8-4c70-8073-8ac5dcd85453 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:18.813023 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-9be80e2d-85a8-4c70-8073-8ac5dcd85453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:18.824294 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:18.846861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a997c0-9c57-449b-ba9a-c1878e71b11c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:18.893245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:18.895302 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:18.895592 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:18.895874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:18.905176 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:18.905925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 350/689] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:18.909086 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:18.924690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:18.925652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:18.926620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 340/690] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:18.932458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:18.932596 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80e2d-85a8-4c70-8073-8ac5dcd85453 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:19.042515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b117-ebc7-41aa-9080-4633997726c7 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:19.043444 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be80e2d-85a8-4c70-8073-8ac5dcd85453 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:19.070636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:19.079237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:19.080029 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:19.080340 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:19.080615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:19.081260 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:19.083153 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:19.084964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:19.085811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:19.086245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:19.086670 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:19.087611 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:19.088072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:19.089733 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:19.094910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:19.096062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:19.097859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:19.101734 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 341/691] 10.222.0.72 () {56 vars in 1105 bytes} [Thu Jul 14 18:50:18 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:19.102572 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:19.111637 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 351/692] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:19.112586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:19.113258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:19.232700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ced57-03b2-46b7-83d4-35370f90c368 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:19.274461 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:19.276075 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:19.276536 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:19.276964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] PATH_INFO: `/v3/projects/f1e951324636416eb0436eea3812cafd/users/6baca856645346b39ef5a3ec8f052891/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:19.280643 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e951324636416eb0436eea3812cafd, user_id=6baca856645346b39ef5a3ec8f052891, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:19.282314 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:19.304522 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 352/693] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:50:19 2022] PUT /identity/v3/projects/f1e951324636416eb0436eea3812cafd/users/6baca856645346b39ef5a3ec8f052891/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:50:19.341028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbac4f-ef0d-4103-a2c4-f9e54cc5b2b4 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:19.381605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:19.382285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:19.382547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:19.382849 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:19.383531 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] RBAC: Adding query filter params (name=image) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:19.383831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:19.385247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:19.391048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 342/694] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:19.398199 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:19.455120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:19.518547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd87f-ae41-430a-888a-2350fa3bebfe None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:19.557018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:19.557973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:19.558412 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:19.558843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:19.559759 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] RBAC: Adding query filter params (type=image) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:19.560250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:19.561863 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:19.568282 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 353/695] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:19.574298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:19.647190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:19.680056 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f0772-4157-4773-9224-a813a9261261 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:19.714654 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ebf3a-a2d3-4c60-8a36-677a58a287e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:19.715650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ebf3a-a2d3-4c60-8a36-677a58a287e3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:19.716108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ebf3a-a2d3-4c60-8a36-677a58a287e3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:19.716582 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ebf3a-a2d3-4c60-8a36-677a58a287e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:19.717535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ebf3a-a2d3-4c60-8a36-677a58a287e3 None admin] RBAC: Adding query filter params (interface=public, service_id=7e6147410303492ca9b512d42abc303f, region_id=RegionOne) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:19.718047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ebf3a-a2d3-4c60-8a36-677a58a287e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:19.719601 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ebf3a-a2d3-4c60-8a36-677a58a287e3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:19.728544 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 343/696] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Jul 14 18:50:19 2022] GET /identity/v3/endpoints?service_id=7e6147410303492ca9b512d42abc303f&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:19.737637 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:19.844653 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdacea6-54a8-480f-807f-ab58d722f79a None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:19.857626 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:19.887970 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63505aa5-acef-4ccf-aa56-e94655aff894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:19.888671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505aa5-acef-4ccf-aa56-e94655aff894 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:19.888957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505aa5-acef-4ccf-aa56-e94655aff894 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:19.889235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505aa5-acef-4ccf-aa56-e94655aff894 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:19.889916 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63505aa5-acef-4ccf-aa56-e94655aff894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:19.891287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63505aa5-acef-4ccf-aa56-e94655aff894 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:19.897487 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 354/697] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Jul 14 18:50:19 2022] GET /identity/v3/services => generated 1002 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:50:20.127693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcff2a-4308-4b16-b0fe-9c51abecad83 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.128062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcff2a-4308-4b16-b0fe-9c51abecad83 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.128491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcff2a-4308-4b16-b0fe-9c51abecad83 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.130190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 344/698] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:20.135458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78b89e-801f-40a7-b6cf-71e223402ae4 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.135837 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78b89e-801f-40a7-b6cf-71e223402ae4 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.136222 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78b89e-801f-40a7-b6cf-71e223402ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.153288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-3c78b89e-801f-40a7-b6cf-71e223402ae4 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:20.154474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-3c78b89e-801f-40a7-b6cf-71e223402ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:20.223119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 355/699] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:20.246751 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcff2a-4308-4b16-b0fe-9c51abecad83 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:20.364283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcff2a-4308-4b16-b0fe-9c51abecad83 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:20.400684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ccf95-cea5-42f1-9c2e-96879db18f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:20.401463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ccf95-cea5-42f1-9c2e-96879db18f00 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.401749 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ccf95-cea5-42f1-9c2e-96879db18f00 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.402025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ccf95-cea5-42f1-9c2e-96879db18f00 None admin] PATH_INFO: `/v3/services/network` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.402735 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ccf95-cea5-42f1-9c2e-96879db18f00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:20.404105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ccf95-cea5-42f1-9c2e-96879db18f00 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:20.406006 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-5a2ccf95-cea5-42f1-9c2e-96879db18f00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:20.417225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:20.419190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:20.420848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 345/700] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:20 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:20.424882 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78b89e-801f-40a7-b6cf-71e223402ae4 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:20.496428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a11b-d30f-4a9b-92cd-560b34aa2e46 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.496748 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a11b-d30f-4a9b-92cd-560b34aa2e46 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.497020 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a11b-d30f-4a9b-92cd-560b34aa2e46 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.498706 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 346/701] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:20.503621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393712f7-32dc-4d9b-904a-f016838a9ee0 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.503909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393712f7-32dc-4d9b-904a-f016838a9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.504190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393712f7-32dc-4d9b-904a-f016838a9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.522180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-393712f7-32dc-4d9b-904a-f016838a9ee0 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:20.523388 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-393712f7-32dc-4d9b-904a-f016838a9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:20.531254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78b89e-801f-40a7-b6cf-71e223402ae4 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:20.534119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:20.569446 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:20.570114 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.570398 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.570668 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.571364 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] RBAC: Adding query filter params (name=network) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:20.571666 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:20.573058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:20.578503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 356/702] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:20.584784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:20.611359 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 347/703] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:20.637170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393712f7-32dc-4d9b-904a-f016838a9ee0 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:20.704687 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6109e8-3cba-4ad9-85aa-ab680e64e89b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:20.744058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:20.744769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.745151 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.745515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.746099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393712f7-32dc-4d9b-904a-f016838a9ee0 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:20.746288 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] RBAC: Adding query filter params (type=network) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:20.746617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:20.748267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:20.754358 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 357/704] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:20.760562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:20.792485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:20.800233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:20.811965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:20.813169 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.813880 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.814742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.815622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:20.817754 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:20.834719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:20.835650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:20.836623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:20.843362 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 348/705] 10.222.0.72 () {56 vars in 1129 bytes} [Thu Jul 14 18:50:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:20.843362 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:20.875623 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2053a96-b14f-4d86-b358-1c242d3306ed None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:20.912161 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:20.912977 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:20.913267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:20.913590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:20.914375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] RBAC: Adding query filter params (interface=public, service_id=43da05e3e88e4e6e93cd27f99ebf9384, region_id=RegionOne) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:20.914780 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:20.916043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:20.928234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 358/706] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Jul 14 18:50:20 2022] GET /identity/v3/endpoints?service_id=43da05e3e88e4e6e93cd27f99ebf9384&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:20.931145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:20.970643 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4ad9-1ea2-4e97-addd-451e0c200fde None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:21.007341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:21.007998 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:21.008333 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:21.008609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:21.009410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:21.009718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:21.011173 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:21.020649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 349/707] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Jul 14 18:50:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:21.021694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:21.057916 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:21.066200 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b70f8-7356-469a-ac81-113be9008026 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:21.093218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:21.107388 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:21.108555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:21.109050 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:21.109529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:21.110480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:21.112167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:21.124521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 359/708] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Jul 14 18:50:20 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:50:21.146726 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedfd4a-178c-474f-8a97-b0c88954b6a6 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:21.186622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:21.187299 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:21.187581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:21.187855 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:21.188605 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:21.188913 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:21.190334 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:21.196736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 350/709] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Jul 14 18:50:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:21.202710 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:21.321669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b79c90-f234-4882-966d-d33922df4988 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:21.359861 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cbe36-a73b-4087-88f9-60bc08b2787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:21.360622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbe36-a73b-4087-88f9-60bc08b2787b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:21.360918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbe36-a73b-4087-88f9-60bc08b2787b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:21.361180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbe36-a73b-4087-88f9-60bc08b2787b None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:21.361973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cbe36-a73b-4087-88f9-60bc08b2787b None admin] RBAC: Adding query filter params (interface=public, service_id=76684ad5434548f6b8f00b03ec3eb256, region_id=RegionOne) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:21.363455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cbe36-a73b-4087-88f9-60bc08b2787b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:21.364227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cbe36-a73b-4087-88f9-60bc08b2787b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:21.370149 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 360/710] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Jul 14 18:50:21 2022] GET /identity/v3/endpoints?service_id=76684ad5434548f6b8f00b03ec3eb256&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:21.377276 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:21.484910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf4b6d-31cd-438f-a41b-413a14019405 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:21.506694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:21.523248 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c0b14-4cfa-4a6d-b747-62519a66c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:21.523943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c0b14-4cfa-4a6d-b747-62519a66c34f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:21.524252 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c0b14-4cfa-4a6d-b747-62519a66c34f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:21.524528 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c0b14-4cfa-4a6d-b747-62519a66c34f None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:21.525221 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c0b14-4cfa-4a6d-b747-62519a66c34f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:21.526636 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c0b14-4cfa-4a6d-b747-62519a66c34f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:21.534062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 351/711] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Jul 14 18:50:21 2022] GET /identity/v3/services => generated 1002 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:50:21.686227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aeef5-844f-41d4-b1f6-804b6d93a147 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:21.686227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aeef5-844f-41d4-b1f6-804b6d93a147 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:21.686227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aeef5-844f-41d4-b1f6-804b6d93a147 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:21.686227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 361/712] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:21.696151 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c6d14-43b5-46d5-a2d6-15db3b8b9801 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:21.696458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c6d14-43b5-46d5-a2d6-15db3b8b9801 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:21.696740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c6d14-43b5-46d5-a2d6-15db3b8b9801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:21.725533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-200c6d14-43b5-46d5-a2d6-15db3b8b9801 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:21.726761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-200c6d14-43b5-46d5-a2d6-15db3b8b9801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:21.816746 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 352/713] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:21.839483 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aeef5-844f-41d4-b1f6-804b6d93a147 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:21.870711 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:21.997720 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aeef5-844f-41d4-b1f6-804b6d93a147 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.034175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:22.035542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.035828 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.036103 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.048518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:50:22.057430 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:22.058341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:50:22.059179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:22.063620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 362/714] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:22.065309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c6d14-43b5-46d5-a2d6-15db3b8b9801 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.171099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c6d14-43b5-46d5-a2d6-15db3b8b9801 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.185627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:22.206213 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c4d9-7735-4ee0-b1b9-919620045980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:22.207430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c4d9-7735-4ee0-b1b9-919620045980 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.207721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c4d9-7735-4ee0-b1b9-919620045980 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.208003 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c4d9-7735-4ee0-b1b9-919620045980 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.208791 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c4d9-7735-4ee0-b1b9-919620045980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:22.209104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c4d9-7735-4ee0-b1b9-919620045980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:22.210480 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c4d9-7735-4ee0-b1b9-919620045980 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:22.224348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 353/715] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:22.226547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.320092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:22.339078 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ffb2-1af1-4e45-8249-841878b6204c None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.375969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:22.376803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.377091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.377368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.386221 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b1e83-27af-4aa2-9fc9-0e422a55b24c None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.386511 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b1e83-27af-4aa2-9fc9-0e422a55b24c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.386797 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b1e83-27af-4aa2-9fc9-0e422a55b24c None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.389009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 354/716] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:22.390088 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:22.391551 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:22.397844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28c370-a028-4947-b8ef-71461501f20a None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.398115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28c370-a028-4947-b8ef-71461501f20a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.398391 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28c370-a028-4947-b8ef-71461501f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.415372 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-4e28c370-a028-4947-b8ef-71461501f20a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:22.416569 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-4e28c370-a028-4947-b8ef-71461501f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:22.418568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:22.419459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:22.420414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:22.420414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:22.420414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:22.420414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:22.426217 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 363/717] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:22.435432 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.505577 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 355/718] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:22.528156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28c370-a028-4947-b8ef-71461501f20a None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.558033 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774b1b-6d03-4e4a-9f9e-f576ab7877fd None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.606287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:22.606949 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.607234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.607508 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.608260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:22.608555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:22.609899 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:22.612701 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:22.623397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 364/719] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:22.629328 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.652580 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28c370-a028-4947-b8ef-71461501f20a None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.663250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:22.702854 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:22.704099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.705116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.705540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] PATH_INFO: `/v3/services/image` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.706691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:22.708881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:22.727171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:22.728190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 18:50:22.729071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:22.729814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 356/720] 10.222.0.72 () {56 vars in 1105 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:22.735442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.750058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe78e5-28cd-44cb-b744-f31905aa13e1 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.796735 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:22.797512 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.797857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.798142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] PATH_INFO: `/v3/users/nova` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.806171 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:22.807739 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:22.822700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:22.823706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 18:50:22.824681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:22.828664 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 365/721] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:22.829941 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.872885 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196b533-e52f-48d1-a28c-44250c3a9880 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.899281 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:22.922074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:22.922743 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:22.923026 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:22.923304 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:22.924015 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] RBAC: Adding query filter params (name=image) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:22.924372 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:22.926827 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:22.933957 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 357/722] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:22.939242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:22.956529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8fae-94af-49a4-a6ca-d99e98571642 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:22.988728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:23.000224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.000955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.001235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.001506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.002342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:23.002649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.004698 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.023876 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 366/723] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:23.029977 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.075874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d25bf-93bd-4c2a-b201-83e6d6514f76 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.115247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.116353 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.116838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.117311 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.118290 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] RBAC: Adding query filter params (type=image) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:23.118798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.120422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.132217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 358/724] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:23.133327 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.154837 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872c5f6-b011-44d5-8789-65b8caa36a05 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.174775 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:23.208817 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47925f58-fb65-4b47-9568-81994d627b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.209397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925f58-fb65-4b47-9568-81994d627b3d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.209685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925f58-fb65-4b47-9568-81994d627b3d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.209961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925f58-fb65-4b47-9568-81994d627b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.243244 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:23.247848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15b6f-5856-4d89-b849-0b8d1cc40ef7 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.296428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.297659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.298175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.298654 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.299868 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.302742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.308461 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47925f58-fb65-4b47-9568-81994d627b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.309961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47925f58-fb65-4b47-9568-81994d627b3d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.332715 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 359/725] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Jul 14 18:50:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:50:23.446895 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 367/726] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:50:23 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 18:50:23.452424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.480524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543797-d466-4161-afd5-13949220dce8 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.480774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543797-d466-4161-afd5-13949220dce8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.481011 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543797-d466-4161-afd5-13949220dce8 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.482696 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 368/727] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:23.488248 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1e75-525a-4bdf-ad17-097809f3ca52 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.488563 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1e75-525a-4bdf-ad17-097809f3ca52 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.488846 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1e75-525a-4bdf-ad17-097809f3ca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.505992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-48ad1e75-525a-4bdf-ad17-097809f3ca52 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:23.507951 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-48ad1e75-525a-4bdf-ad17-097809f3ca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:23.529691 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:23.578118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b5e9-99d6-4fb5-9b36-9753b1675a3c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.594111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 369/728] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:23 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:23.619240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1e75-525a-4bdf-ad17-097809f3ca52 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.619521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13507-044f-4344-8824-5c74f977115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.620365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13507-044f-4344-8824-5c74f977115c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.620651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13507-044f-4344-8824-5c74f977115c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.620931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13507-044f-4344-8824-5c74f977115c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.632249 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13507-044f-4344-8824-5c74f977115c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.633778 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13507-044f-4344-8824-5c74f977115c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-24b13507-044f-4344-8824-5c74f977115c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:23.652844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:23.653783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:23.654738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:23.654738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:23.654738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:23.654738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:23.658862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 360/729] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:23.660685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13507-044f-4344-8824-5c74f977115c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.663522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:23.729703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1e75-525a-4bdf-ad17-097809f3ca52 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.765968 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.766694 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.766965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.767244 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] PATH_INFO: `/v3/services/network` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.767902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.769325 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.773721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13507-044f-4344-8824-5c74f977115c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:23.782447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:23.784496 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 18:50:23.786333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:23.792241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 370/730] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:23 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:23.792241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.802035 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:23.819087 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.819807 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.820098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.820466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.821190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:23.821506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.822874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.840345 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 361/731] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:23.841984 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.898997 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dfa51-2ef7-4130-8f93-ebdc8138127f None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.911065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:23.937302 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.938019 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.938346 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.938633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:23.939377 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] RBAC: Adding query filter params (name=network) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:23.939918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:23.942127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:23.953743 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 371/732] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:23.954675 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:23.959711 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63582ce5-c2e2-48e4-b197-f0bfeed16006 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:23.997045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:23.997797 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:23.998085 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:23.998365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.006422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.007886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:24.022438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:24.024672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:24.026752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:24.032245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 362/733] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:24.032245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:24.056557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:24.060749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56951-7a6d-438b-b665-decab249aa7a None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.098363 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127138-954b-4b72-bdbe-c9cadb2049f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:24.099038 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127138-954b-4b72-bdbe-c9cadb2049f6 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.099445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127138-954b-4b72-bdbe-c9cadb2049f6 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.099725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127138-954b-4b72-bdbe-c9cadb2049f6 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.100607 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a127138-954b-4b72-bdbe-c9cadb2049f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:24.100917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a127138-954b-4b72-bdbe-c9cadb2049f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.102281 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a127138-954b-4b72-bdbe-c9cadb2049f6 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.108279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 372/734] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:24.115254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013701-a29e-47b6-addf-f93938760779 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.115548 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013701-a29e-47b6-addf-f93938760779 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.115830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013701-a29e-47b6-addf-f93938760779 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.120984 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 373/735] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:24.120984 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0013701-a29e-47b6-addf-f93938760779 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:24.143172 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9331256-23a9-4a1f-b131-b231f85db16e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.167685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:24.182060 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ee9a-d7c9-40ca-ab9d-a1a82586b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:24.182821 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ee9a-d7c9-40ca-ab9d-a1a82586b163 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.183114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ee9a-d7c9-40ca-ab9d-a1a82586b163 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.183386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ee9a-d7c9-40ca-ab9d-a1a82586b163 None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.184252 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ee9a-d7c9-40ca-ab9d-a1a82586b163 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:24.184568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ee9a-d7c9-40ca-ab9d-a1a82586b163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.186202 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ee9a-d7c9-40ca-ab9d-a1a82586b163 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.200017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 363/736] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:24.201121 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6204c0-91a3-4a65-b572-bcd6bf1ba3f8 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.201409 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6204c0-91a3-4a65-b572-bcd6bf1ba3f8 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.201684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6204c0-91a3-4a65-b572-bcd6bf1ba3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.218692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ba6204c0-91a3-4a65-b572-bcd6bf1ba3f8 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:24.219876 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ba6204c0-91a3-4a65-b572-bcd6bf1ba3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:24.228506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0013701-a29e-47b6-addf-f93938760779 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.267338 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:24.268157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.268519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.268815 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.269606 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.270967 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.276621 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:24.296243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 374/737] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Jul 14 18:50:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:50:24.296243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:24.315436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 364/738] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:24 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:24.339753 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6204c0-91a3-4a65-b572-bcd6bf1ba3f8 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:24.429939 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d39c44-56a0-4013-a7e8-3399c3d593d5 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.466080 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6204c0-91a3-4a65-b572-bcd6bf1ba3f8 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.476886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:24.477658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.477954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.478237 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.479077 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=6baca856645346b39ef5a3ec8f052891) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:24.479394 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.479892 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:24.481743 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.497348 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 375/739] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:50:24 2022] GET /identity/v3/role_assignments?user.id=6baca856645346b39ef5a3ec8f052891&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:24.514546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:24.515389 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.515673 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.515944 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.516658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.518086 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:24.531644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:24.532688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:24.533573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 365/740] 10.222.0.72 () {56 vars in 1129 bytes} [Thu Jul 14 18:50:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:24.541404 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:24.614017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:24.664688 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d0690-bdd2-485c-b1ac-b2a59e8513cf None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.701287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:24.701963 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.702248 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.702527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.703238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:24.703545 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.704979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.710524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 376/741] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Jul 14 18:50:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:24.716621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:24.825062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344f25-2519-4c73-ad31-ff15eca7dbdf None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.857659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12f58-39cc-45c6-a978-72d15a9c9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:24.858320 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12f58-39cc-45c6-a978-72d15a9c9354 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:24.858603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12f58-39cc-45c6-a978-72d15a9c9354 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:24.858878 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12f58-39cc-45c6-a978-72d15a9c9354 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:24.859613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12f58-39cc-45c6-a978-72d15a9c9354 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:24.859917 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12f58-39cc-45c6-a978-72d15a9c9354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:24.861309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12f58-39cc-45c6-a978-72d15a9c9354 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:24.866572 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 366/742] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Jul 14 18:50:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:24.872418 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:24.975258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d1b26-b669-484f-a4ba-f4b73631976f None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:24.995233 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:25.010533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916443a4-d376-47fa-a680-842465e11965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:25.011195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916443a4-d376-47fa-a680-842465e11965 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:25.011532 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916443a4-d376-47fa-a680-842465e11965 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:25.011811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916443a4-d376-47fa-a680-842465e11965 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:25.012616 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916443a4-d376-47fa-a680-842465e11965 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:25.013987 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916443a4-d376-47fa-a680-842465e11965 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:25.040235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 377/743] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Jul 14 18:50:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:50:25.669129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b710d-2d38-487b-a065-9bab273c0ef9 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:25.669335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b710d-2d38-487b-a065-9bab273c0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:25.669611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b710d-2d38-487b-a065-9bab273c0ef9 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:25.671093 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 367/744] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:25.677053 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e26ea9-e290-4c58-8f67-b5ea01e6bfe9 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:25.677346 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e26ea9-e290-4c58-8f67-b5ea01e6bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:25.677628 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e26ea9-e290-4c58-8f67-b5ea01e6bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:25.695267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-22e26ea9-e290-4c58-8f67-b5ea01e6bfe9 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:25.696518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-22e26ea9-e290-4c58-8f67-b5ea01e6bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:25.770893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 378/745] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:25 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:25.796457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b710d-2d38-487b-a065-9bab273c0ef9 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:25.835025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:25.901111 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b710d-2d38-487b-a065-9bab273c0ef9 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:25.935193 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:25.935760 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:25.936039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:25.936338 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:26.002389 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:26.003841 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:26.036059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:26.101261 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 368/746] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:50:25 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 18:50:26.106720 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e26ea9-e290-4c58-8f67-b5ea01e6bfe9 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:26.206283 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e26ea9-e290-4c58-8f67-b5ea01e6bfe9 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:26.208463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:26.242786 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0bcd-8629-4f79-8364-d34c6b994af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:26.243577 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0bcd-8629-4f79-8364-d34c6b994af4 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:26.243857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0bcd-8629-4f79-8364-d34c6b994af4 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:26.244127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0bcd-8629-4f79-8364-d34c6b994af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:26.254336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e0bcd-8629-4f79-8364-d34c6b994af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:26.255782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e0bcd-8629-4f79-8364-d34c6b994af4 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-147e0bcd-8629-4f79-8364-d34c6b994af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:50:26.275966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:26.276979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:26.277897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:50:26.277897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:50:26.277897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:50:26.277897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:26.278624 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 379/747] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:26.286166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:26.385712 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b263fca-e5d6-4b7d-bc17-6339e6038b04 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:26.418834 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7fcbe-434c-419b-ba28-05c29bc0e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:26.419493 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7fcbe-434c-419b-ba28-05c29bc0e07a None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:26.419775 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7fcbe-434c-419b-ba28-05c29bc0e07a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:26.420113 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7fcbe-434c-419b-ba28-05c29bc0e07a None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:26.420878 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7fcbe-434c-419b-ba28-05c29bc0e07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:26.421187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7fcbe-434c-419b-ba28-05c29bc0e07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:26.422558 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7fcbe-434c-419b-ba28-05c29bc0e07a None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:26.424917 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:26.435983 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 369/748] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:26.804441 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231154bd-2db3-407a-93e9-b26600dc2476 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:26.804733 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231154bd-2db3-407a-93e9-b26600dc2476 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:26.805018 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231154bd-2db3-407a-93e9-b26600dc2476 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:26.806383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 380/749] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:26.811670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e9d89-c086-4eb5-b12f-0762f61a0316 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:26.812122 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e9d89-c086-4eb5-b12f-0762f61a0316 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:26.812259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e9d89-c086-4eb5-b12f-0762f61a0316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:26.828615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-329e9d89-c086-4eb5-b12f-0762f61a0316 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:26.829809 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-329e9d89-c086-4eb5-b12f-0762f61a0316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:26.896767 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 370/750] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:26 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:26.919780 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231154bd-2db3-407a-93e9-b26600dc2476 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:27.020645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231154bd-2db3-407a-93e9-b26600dc2476 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:27.054061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:27.054915 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.055148 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.055423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.056069 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:27.057465 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:27.070234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:27.071340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:27.072367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 381/751] 10.222.0.72 () {56 vars in 1132 bytes} [Thu Jul 14 18:50:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:27.077326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e9d89-c086-4eb5-b12f-0762f61a0316 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:27.176908 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e9d89-c086-4eb5-b12f-0762f61a0316 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:27.202790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:27.212253 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8941f0c-dc9b-4e75-93b5-0b144ea17de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:27.212927 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8941f0c-dc9b-4e75-93b5-0b144ea17de8 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.213218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8941f0c-dc9b-4e75-93b5-0b144ea17de8 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.213500 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8941f0c-dc9b-4e75-93b5-0b144ea17de8 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.214208 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8941f0c-dc9b-4e75-93b5-0b144ea17de8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:27.214521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8941f0c-dc9b-4e75-93b5-0b144ea17de8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:27.215889 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8941f0c-dc9b-4e75-93b5-0b144ea17de8 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:27.220439 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 371/752] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Jul 14 18:50:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:27.226687 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:27.246306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:27.306522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d69d2-8dea-4dd2-82c8-63085c111e31 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.306742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d69d2-8dea-4dd2-82c8-63085c111e31 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.307017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d69d2-8dea-4dd2-82c8-63085c111e31 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.308386 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 372/753] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:27.313050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51397-cc4b-4698-a5ae-ac9272bfb113 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.313337 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51397-cc4b-4698-a5ae-ac9272bfb113 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.313611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc51397-cc4b-4698-a5ae-ac9272bfb113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.329806 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ecc51397-cc4b-4698-a5ae-ac9272bfb113 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:27.331001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ecc51397-cc4b-4698-a5ae-ac9272bfb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:27.336127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4d481-1f6a-46a4-ae65-387ebe11b1e0 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:27.370751 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:27.371408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.371699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.371996 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.372721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:27.373034 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:27.374432 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:27.378907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 382/754] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Jul 14 18:50:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:27.398524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 373/755] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:27 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:27.422904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:27.510505 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:27.530053 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5de24e-1a25-40d8-852e-dba8271dbd82 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:27.566358 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:27.567094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.567383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.567665 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.568362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:27.569734 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:27.582260 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:27.583252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:27.584105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 383/756] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:27.589361 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc51397-cc4b-4698-a5ae-ac9272bfb113 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:27.686720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc51397-cc4b-4698-a5ae-ac9272bfb113 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:27.706350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:27.721047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d0a32-2d8e-4bfd-9e89-327a583a1342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:27.721712 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d0a32-2d8e-4bfd-9e89-327a583a1342 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.721999 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d0a32-2d8e-4bfd-9e89-327a583a1342 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.722825 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d0a32-2d8e-4bfd-9e89-327a583a1342 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.723533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d0a32-2d8e-4bfd-9e89-327a583a1342 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:27.723845 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d0a32-2d8e-4bfd-9e89-327a583a1342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:27.725246 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d0a32-2d8e-4bfd-9e89-327a583a1342 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:27.729816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 374/757] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:27.735371 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:27.834531 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cd8f-9cf3-4d1b-977d-7df5dca318ab None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:27.868584 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470fff-6caf-4a41-8bb3-3fd744f80f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:27.869250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470fff-6caf-4a41-8bb3-3fd744f80f63 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:27.869538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470fff-6caf-4a41-8bb3-3fd744f80f63 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:27.869819 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470fff-6caf-4a41-8bb3-3fd744f80f63 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:27.870532 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470fff-6caf-4a41-8bb3-3fd744f80f63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:27.870844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470fff-6caf-4a41-8bb3-3fd744f80f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:27.872254 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470fff-6caf-4a41-8bb3-3fd744f80f63 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:27.876752 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 384/758] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:29.585677 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0328-b186-4263-bab7-1c2decf6021a None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:29.586199 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0328-b186-4263-bab7-1c2decf6021a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:29.586199 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0328-b186-4263-bab7-1c2decf6021a None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:29.587478 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 375/759] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:29.592695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73b9d-252b-4dfd-a4e7-fe3c5f8839a1 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:29.593098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73b9d-252b-4dfd-a4e7-fe3c5f8839a1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:29.593262 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73b9d-252b-4dfd-a4e7-fe3c5f8839a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:29.609657 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-5be73b9d-252b-4dfd-a4e7-fe3c5f8839a1 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:29.610843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-5be73b9d-252b-4dfd-a4e7-fe3c5f8839a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:29.613585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:29.678446 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 385/760] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:29 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:29.701576 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0328-b186-4263-bab7-1c2decf6021a None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:29.801014 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0328-b186-4263-bab7-1c2decf6021a None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:29.833559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615521a2-db75-460b-83ad-c26e76f21c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:29.834211 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615521a2-db75-460b-83ad-c26e76f21c26 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:29.834491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615521a2-db75-460b-83ad-c26e76f21c26 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:29.834762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615521a2-db75-460b-83ad-c26e76f21c26 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:29.835470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615521a2-db75-460b-83ad-c26e76f21c26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:29.836905 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615521a2-db75-460b-83ad-c26e76f21c26 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:29.849341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 376/761] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:50:29 2022] POST /identity/v3/services => generated 269 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:50:30.090659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26458099-6b15-49bf-bde4-f6b96eec282d None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:30.090870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26458099-6b15-49bf-bde4-f6b96eec282d None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:30.091157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26458099-6b15-49bf-bde4-f6b96eec282d None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:30.092568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 386/762] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:30.097840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead12e19-d6cd-4d74-b9e6-3a70d6d9d200 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:30.098133 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead12e19-d6cd-4d74-b9e6-3a70d6d9d200 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:30.098416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead12e19-d6cd-4d74-b9e6-3a70d6d9d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:30.116129 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ead12e19-d6cd-4d74-b9e6-3a70d6d9d200 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:30.117636 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ead12e19-d6cd-4d74-b9e6-3a70d6d9d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:30.157730 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:30.191701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 377/763] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:30 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:30.215143 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26458099-6b15-49bf-bde4-f6b96eec282d None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:30.433016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26458099-6b15-49bf-bde4-f6b96eec282d None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:30.465629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b33f-35c9-4b6e-8929-7d2f54d00b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:30.466284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b33f-35c9-4b6e-8929-7d2f54d00b9a None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:30.466565 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b33f-35c9-4b6e-8929-7d2f54d00b9a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:30.466839 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b33f-35c9-4b6e-8929-7d2f54d00b9a None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:30.467558 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b33f-35c9-4b6e-8929-7d2f54d00b9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:30.468956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b33f-35c9-4b6e-8929-7d2f54d00b9a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:30.478568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:30.489428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 387/764] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:50:30 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:50:32.083101 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce083b9-f080-42ca-bbb5-87e4b0fa7ab7 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.083633 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce083b9-f080-42ca-bbb5-87e4b0fa7ab7 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.083751 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce083b9-f080-42ca-bbb5-87e4b0fa7ab7 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.085126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 378/765] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:32.090347 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c9122-3469-482c-88cc-6a2c310bfeb4 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.090733 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c9122-3469-482c-88cc-6a2c310bfeb4 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.090914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c9122-3469-482c-88cc-6a2c310bfeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.107685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-da8c9122-3469-482c-88cc-6a2c310bfeb4 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:32.109025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-da8c9122-3469-482c-88cc-6a2c310bfeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:32.178481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 388/766] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:32 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:32.201884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce083b9-f080-42ca-bbb5-87e4b0fa7ab7 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:32.302202 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce083b9-f080-42ca-bbb5-87e4b0fa7ab7 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:32.334939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:32.335670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.335950 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.336247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.336893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:32.338250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:32.350808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:32.351728 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:32.352816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 379/767] 10.222.0.72 () {56 vars in 1132 bytes} [Thu Jul 14 18:50:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:32.357863 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c9122-3469-482c-88cc-6a2c310bfeb4 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:32.455950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c9122-3469-482c-88cc-6a2c310bfeb4 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:32.480995 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:32.489775 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:32.490433 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.490715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.490987 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.491687 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:32.491992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:32.493378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:32.498006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 389/768] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Jul 14 18:50:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:32.504276 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:32.538137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:32.610076 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46787b7-b06f-4da3-81d9-996159b63340 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:32.643209 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2bb18-aa3d-4373-8c18-4e9c1a3a2b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:32.643888 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2bb18-aa3d-4373-8c18-4e9c1a3a2b47 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.644692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2bb18-aa3d-4373-8c18-4e9c1a3a2b47 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.644965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2bb18-aa3d-4373-8c18-4e9c1a3a2b47 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.645658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2bb18-aa3d-4373-8c18-4e9c1a3a2b47 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:32.645959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2bb18-aa3d-4373-8c18-4e9c1a3a2b47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:32.647310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2bb18-aa3d-4373-8c18-4e9c1a3a2b47 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:32.652012 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 380/769] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Jul 14 18:50:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:32.657771 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:32.730498 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267f6d-3c66-4a9a-b8a7-f64c221b70f0 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.730868 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267f6d-3c66-4a9a-b8a7-f64c221b70f0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.731159 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267f6d-3c66-4a9a-b8a7-f64c221b70f0 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.732773 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 381/770] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:32.738441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222685-7bfa-4570-b73c-c2608e3b376d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.738914 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222685-7bfa-4570-b73c-c2608e3b376d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.739201 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222685-7bfa-4570-b73c-c2608e3b376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.756168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-29222685-7bfa-4570-b73c-c2608e3b376d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:32.757393 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-29222685-7bfa-4570-b73c-c2608e3b376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:32.757508 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef210-bcea-4a02-a66e-abd30a050137 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:32.791012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:32.791664 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.792225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.792509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.793297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] RBAC: Adding query filter params (interface=public, service_id=488f3a0e07684027b739f1a42da8643e, region_id=RegionOne) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:32.793611 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:32.794961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:32.800904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 390/771] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Jul 14 18:50:32 2022] GET /identity/v3/endpoints?service_id=488f3a0e07684027b739f1a42da8643e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:32.806489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:32.828240 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 382/772] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:32 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:32.847243 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29222685-7bfa-4570-b73c-c2608e3b376d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:32.859382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:32.874990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:32.905592 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c6b9-f26e-4196-85a4-4619b0fc107b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:32.939605 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:32.940373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.940759 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.941732 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.942523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:32.944226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:32.949497 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29222685-7bfa-4570-b73c-c2608e3b376d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:32.950598 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 391/773] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Jul 14 18:50:32 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:50:32.984981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:32.985802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:32.986086 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:32.986361 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:32.987023 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:32.989005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:33.001665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:33.002718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:33.004225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 383/774] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:50:33.009801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:33.114352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc94b-3552-4dfb-8c52-e46a8073bd3e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:33.133432 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:33.150194 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:33.150856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:33.151136 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:33.151410 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:33.152110 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:33.152442 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:33.153796 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:33.158444 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 392/775] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:33.164291 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:33.253817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:33.262780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad132b61-74e1-4968-871a-0f2d7398daee None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:33.299247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:33.299913 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:33.300797 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:33.301085 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:33.301793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:33.302108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:33.303469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:33.312935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 384/776] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:33.314029 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:33.412077 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d344d2-d6f2-4c5d-8d0a-7888a0ef5756 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:33.445230 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a447a7-9fcb-44f6-b1ba-4ecf6497ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:33.445885 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a447a7-9fcb-44f6-b1ba-4ecf6497ac23 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:33.446225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a447a7-9fcb-44f6-b1ba-4ecf6497ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:33.446501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a447a7-9fcb-44f6-b1ba-4ecf6497ac23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:33.447279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a447a7-9fcb-44f6-b1ba-4ecf6497ac23 None admin] RBAC: Adding query filter params (interface=public, service_id=0f03f04efb7d44e1b2c64961fb4ff832, region_id=RegionOne) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:33.447588 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a447a7-9fcb-44f6-b1ba-4ecf6497ac23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:33.448959 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a447a7-9fcb-44f6-b1ba-4ecf6497ac23 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:33.453904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 393/777] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Jul 14 18:50:33 2022] GET /identity/v3/endpoints?service_id=0f03f04efb7d44e1b2c64961fb4ff832&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:50:33.459404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:33.561649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a94da4-dc60-4f69-9bd5-f50de4f52a74 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:33.594074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b99d-4269-44ea-b72b-094c9186bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:33.594729 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b99d-4269-44ea-b72b-094c9186bc62 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:33.595009 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b99d-4269-44ea-b72b-094c9186bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:33.595280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b99d-4269-44ea-b72b-094c9186bc62 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:33.595948 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b99d-4269-44ea-b72b-094c9186bc62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:33.597956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b99d-4269-44ea-b72b-094c9186bc62 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:33.603783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 385/778] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Jul 14 18:50:33 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:50:35.153175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3c45-33dc-4c58-a60e-0e09c5e57947 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.153706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3c45-33dc-4c58-a60e-0e09c5e57947 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.153706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3c45-33dc-4c58-a60e-0e09c5e57947 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.155072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 394/779] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:35.160937 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89617-8f6c-44f2-8614-54e9c90fb9b9 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.161353 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89617-8f6c-44f2-8614-54e9c90fb9b9 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.161489 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89617-8f6c-44f2-8614-54e9c90fb9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.178208 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-aaf89617-8f6c-44f2-8614-54e9c90fb9b9 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:35.179392 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-aaf89617-8f6c-44f2-8614-54e9c90fb9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:35.193005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:35.244826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 386/780] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:35.268312 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b3c45-33dc-4c58-a60e-0e09c5e57947 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:35.318936 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:35.373194 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b3c45-33dc-4c58-a60e-0e09c5e57947 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:35.416226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:35.417226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.417521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.417800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.418457 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:35.419831 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:35.432630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:35.433649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:35.434961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 395/781] 10.222.0.72 () {56 vars in 1132 bytes} [Thu Jul 14 18:50:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:35.439652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89617-8f6c-44f2-8614-54e9c90fb9b9 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:35.537134 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89617-8f6c-44f2-8614-54e9c90fb9b9 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:35.570178 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:35.570828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.571111 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.571385 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.572081 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:35.572419 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:35.573778 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:35.578392 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 387/782] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Jul 14 18:50:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:35.584061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:35.686320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce869a-f651-4cb0-a327-96b9afac4b86 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:35.697027 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:35.720627 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec5c59-2481-4ee2-8d6d-d90ae4f5da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:35.721295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec5c59-2481-4ee2-8d6d-d90ae4f5da91 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.721583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec5c59-2481-4ee2-8d6d-d90ae4f5da91 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.721866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec5c59-2481-4ee2-8d6d-d90ae4f5da91 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.723200 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec5c59-2481-4ee2-8d6d-d90ae4f5da91 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:35.723511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec5c59-2481-4ee2-8d6d-d90ae4f5da91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:35.724963 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec5c59-2481-4ee2-8d6d-d90ae4f5da91 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:35.729727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 396/783] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Jul 14 18:50:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:35.735466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:35.751452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:35.818506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e180a-daa3-48ad-9ba9-5410be972d78 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.818801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e180a-daa3-48ad-9ba9-5410be972d78 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.819083 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e180a-daa3-48ad-9ba9-5410be972d78 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.820488 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 397/784] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:50:35.825319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5baf-7c71-41f2-98b2-ab4e9bbb9a91 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.825610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5baf-7c71-41f2-98b2-ab4e9bbb9a91 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.825896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5baf-7c71-41f2-98b2-ab4e9bbb9a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.837278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2f598-b42c-4fbf-83f7-bf90a480d0dc None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:35.842671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-fa1f5baf-7c71-41f2-98b2-ab4e9bbb9a91 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:35.843864 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-fa1f5baf-7c71-41f2-98b2-ab4e9bbb9a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:35.871580 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:35.872258 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:35.872547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:35.872828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] PATH_INFO: `/v3/endpoints` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:35.873559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:35.874924 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:35.893233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 388/785] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Jul 14 18:50:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:50:35.918087 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 398/786] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:35 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:35.942737 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:36.016476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:36.050870 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bdc38-867f-48fd-8cf6-fa221a38527a None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:36.086132 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:36.086926 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:36.087214 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:36.087476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:36.088118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:36.089560 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:36.102116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:36.103127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:36.104028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 389/787] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:36.109394 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f5baf-7c71-41f2-98b2-ab4e9bbb9a91 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:36.204065 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:36.207779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f5baf-7c71-41f2-98b2-ab4e9bbb9a91 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:36.241382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:36.242054 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:36.242342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:36.242622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:36.243332 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:36.243645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:36.245045 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:36.249729 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 399/788] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:36.256135 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:36.354161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a814c-5988-4700-8549-34ab724cc562 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:36.386667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf48476-4d2f-45d7-9c5d-23b6850e9743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:36.387324 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48476-4d2f-45d7-9c5d-23b6850e9743 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:36.387604 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48476-4d2f-45d7-9c5d-23b6850e9743 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:36.387878 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48476-4d2f-45d7-9c5d-23b6850e9743 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:36.388613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf48476-4d2f-45d7-9c5d-23b6850e9743 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:36.388919 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf48476-4d2f-45d7-9c5d-23b6850e9743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:36.390274 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf48476-4d2f-45d7-9c5d-23b6850e9743 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:36.391553 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:36.400356 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 390/789] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Jul 14 18:50:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:36.402198 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:36.499860 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843328c9-c3a1-4e3e-b85f-75d230ab0d92 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:36.534300 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bda15-c992-483d-9802-ddb5a1b083f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:36.534982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bda15-c992-483d-9802-ddb5a1b083f2 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:36.535274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bda15-c992-483d-9802-ddb5a1b083f2 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:36.535552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bda15-c992-483d-9802-ddb5a1b083f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:36.536340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bda15-c992-483d-9802-ddb5a1b083f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:36.537701 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bda15-c992-483d-9802-ddb5a1b083f2 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:36.556696 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 400/790] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Jul 14 18:50:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:50:38.145790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11de5ac-edd8-48d6-83f4-e5bc5d7ed4ce None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:38.146434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11de5ac-edd8-48d6-83f4-e5bc5d7ed4ce None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:38.146434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11de5ac-edd8-48d6-83f4-e5bc5d7ed4ce None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:38.147671 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 391/791] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:38.152760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a96d-9c1b-4d50-a871-c37345423e94 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:38.153163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a96d-9c1b-4d50-a871-c37345423e94 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:38.153457 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a96d-9c1b-4d50-a871-c37345423e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:38.170681 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-56a7a96d-9c1b-4d50-a871-c37345423e94 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:38.171864 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-56a7a96d-9c1b-4d50-a871-c37345423e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:38.185595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:38.243434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 401/792] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:38.265952 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11de5ac-edd8-48d6-83f4-e5bc5d7ed4ce None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:38.368928 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11de5ac-edd8-48d6-83f4-e5bc5d7ed4ce None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:38.401972 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:38.402680 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:38.402960 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:38.403232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] PATH_INFO: `/v3/services/compute` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:38.403874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:38.405267 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:38.417611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:38.418831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:38.419938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:38.423621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 392/793] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:38.424691 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7a96d-9c1b-4d50-a871-c37345423e94 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:38.520912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7a96d-9c1b-4d50-a871-c37345423e94 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:38.553246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7f6b6-fefe-4747-bb5c-5ed92f8d9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:38.553904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f6b6-fefe-4747-bb5c-5ed92f8d9de4 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:38.554230 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f6b6-fefe-4747-bb5c-5ed92f8d9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:38.554508 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f6b6-fefe-4747-bb5c-5ed92f8d9de4 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:38.555210 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7f6b6-fefe-4747-bb5c-5ed92f8d9de4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:38.555517 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7f6b6-fefe-4747-bb5c-5ed92f8d9de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:38.556916 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7f6b6-fefe-4747-bb5c-5ed92f8d9de4 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:38.561513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 402/794] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:38.568818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:38.631183 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:38.673770 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5ea6e-8c60-4665-88a5-4c881194f34f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:38.707074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644382f-ec9a-407f-ba77-4d902bb133f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:38.707729 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644382f-ec9a-407f-ba77-4d902bb133f1 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:38.708014 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644382f-ec9a-407f-ba77-4d902bb133f1 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:38.708332 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644382f-ec9a-407f-ba77-4d902bb133f1 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:38.709036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644382f-ec9a-407f-ba77-4d902bb133f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:38.709344 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644382f-ec9a-407f-ba77-4d902bb133f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:38.710706 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644382f-ec9a-407f-ba77-4d902bb133f1 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:38.715282 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 393/795] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:38.799778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128a56-f62b-4baf-b8f9-61e70305c779 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:38.800066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128a56-f62b-4baf-b8f9-61e70305c779 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:38.800978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128a56-f62b-4baf-b8f9-61e70305c779 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:38.802371 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 403/796] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:38.808099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf851a-cf10-4847-a5b0-21b8bb9f2f43 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:38.808430 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf851a-cf10-4847-a5b0-21b8bb9f2f43 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:38.808716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf851a-cf10-4847-a5b0-21b8bb9f2f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:38.826237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-aecf851a-cf10-4847-a5b0-21b8bb9f2f43 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:38.827464 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-aecf851a-cf10-4847-a5b0-21b8bb9f2f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:38.898369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 394/797] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:38.923522 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128a56-f62b-4baf-b8f9-61e70305c779 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:38.936293 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:39.027686 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128a56-f62b-4baf-b8f9-61e70305c779 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:39.061168 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:39.061819 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:39.062106 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:39.062383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:39.063093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:39.064556 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:39.066518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING keystone.server.flask.common [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 18:50:39.083097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.sql.core [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 18:50:39.083097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 18:50:39.083097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [parameters: {'id': '31cb2c1f71574c3c8a2b8d1dcc07d0ab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 18:50:39.083097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=120840) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31cb2c1f71574c3c8a2b8d1dcc07d0ab.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31cb2c1f71574c3c8a2b8d1dcc07d0ab. Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application conn.query(q) Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 18:50:39.100091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result.read() Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 18:50:39.100985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application next(self.gen) Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application yield resource Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application next(self.gen) Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise self.value Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application session.commit() Jul 14 18:50:39.102048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.session.flush() Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application compat.raise_( Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 18:50:39.103058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 18:50:39.104062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application conn.query(q) Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result.read() Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 18:50:39.105025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [parameters: {'id': '31cb2c1f71574c3c8a2b8d1dcc07d0ab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:39.105909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:39.106713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31cb2c1f71574c3c8a2b8d1dcc07d0ab. Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:39.107654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 404/798] 10.222.0.72 () {60 vars in 1140 bytes} [Thu Jul 14 18:50:38 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:39.109603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf851a-cf10-4847-a5b0-21b8bb9f2f43 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:39.163068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:39.207733 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf851a-cf10-4847-a5b0-21b8bb9f2f43 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:39.241510 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0e6c4-1686-4d99-8c78-ca52ff1efbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:39.242299 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e6c4-1686-4d99-8c78-ca52ff1efbbd None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:39.242587 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e6c4-1686-4d99-8c78-ca52ff1efbbd None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:39.242867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e6c4-1686-4d99-8c78-ca52ff1efbbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:39.249644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0e6c4-1686-4d99-8c78-ca52ff1efbbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:39.251079 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0e6c4-1686-4d99-8c78-ca52ff1efbbd None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-59b0e6c4-1686-4d99-8c78-ca52ff1efbbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:50:39.264883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:39.265819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:50:39.266736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:39.268484 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 395/799] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:39.272258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:39.341020 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:39.377747 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326ecca-55b5-4bb4-9d06-a0e0f2ddd316 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:39.410641 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9400c-f002-494b-bb3c-2bac28fd4c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:39.411307 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9400c-f002-494b-bb3c-2bac28fd4c27 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:39.411594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9400c-f002-494b-bb3c-2bac28fd4c27 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:39.411871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9400c-f002-494b-bb3c-2bac28fd4c27 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:39.412660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9400c-f002-494b-bb3c-2bac28fd4c27 None admin] RBAC: Adding query filter params (name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:39.412974 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9400c-f002-494b-bb3c-2bac28fd4c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:39.414618 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9400c-f002-494b-bb3c-2bac28fd4c27 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:39.438272 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 405/800] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:40.890599 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc24cd5-a3bd-4a22-a0ce-5f5fdea3380c None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:40.891175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc24cd5-a3bd-4a22-a0ce-5f5fdea3380c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:40.891175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc24cd5-a3bd-4a22-a0ce-5f5fdea3380c None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:40.892577 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 396/801] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:40.897889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e257-3d68-45fc-a26a-9115e60c4256 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:40.898269 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e257-3d68-45fc-a26a-9115e60c4256 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:40.898455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e257-3d68-45fc-a26a-9115e60c4256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:40.915843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-c9a2e257-3d68-45fc-a26a-9115e60c4256 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:40.917633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-c9a2e257-3d68-45fc-a26a-9115e60c4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:40.981246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 406/802] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:40 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:41.004818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc24cd5-a3bd-4a22-a0ce-5f5fdea3380c None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:41.103543 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc24cd5-a3bd-4a22-a0ce-5f5fdea3380c None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:41.119283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:41.136225 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb198bb4-928a-47c7-ab93-4f3034b9cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:41.136887 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb198bb4-928a-47c7-ab93-4f3034b9cc17 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:41.137167 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb198bb4-928a-47c7-ab93-4f3034b9cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:41.137440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb198bb4-928a-47c7-ab93-4f3034b9cc17 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:41.138147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb198bb4-928a-47c7-ab93-4f3034b9cc17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:41.139505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb198bb4-928a-47c7-ab93-4f3034b9cc17 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:41.152621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 397/803] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:50:41 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:50:41.677916 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a40a6-6e3f-44fe-9c1a-20a942d691de None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:41.678216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a40a6-6e3f-44fe-9c1a-20a942d691de None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:41.678498 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a40a6-6e3f-44fe-9c1a-20a942d691de None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:41.679877 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 407/804] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:41.685158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df407ebe-e869-43b6-b547-2ceeccc2102f None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:41.685543 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df407ebe-e869-43b6-b547-2ceeccc2102f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:41.685979 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df407ebe-e869-43b6-b547-2ceeccc2102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:41.703642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-df407ebe-e869-43b6-b547-2ceeccc2102f None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:41.704861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-df407ebe-e869-43b6-b547-2ceeccc2102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:41.776753 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 398/805] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:41 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:41.803097 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a40a6-6e3f-44fe-9c1a-20a942d691de None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:41.861304 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:41.905450 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a40a6-6e3f-44fe-9c1a-20a942d691de None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:41.938871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:41.939473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:41.939761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:41.940039 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:41.941336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:41.942768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:41.955390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.sql.core [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 18:50:41.955390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 18:50:41.955390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [parameters: {'user_id': '9b1dee82e8a44583a712399b0acf83e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 18:50:41.955390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=120840) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application conn.query(q) Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result.read() Jul 14 18:50:41.962699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 18:50:41.963553 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application next(self.gen) Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application yield resource Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application next(self.gen) Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise self.value Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application session.commit() Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 18:50:41.964804 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.session.flush() Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application compat.raise_( Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 18:50:41.965954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 18:50:41.966823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application conn.query(q) Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application result.read() Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 18:50:41.967669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [parameters: {'user_id': '9b1dee82e8a44583a712399b0acf83e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:41.969692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 18:50:41.970699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 18:50:41.972049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 18:50:41.972049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 18:50:41.972049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 18:50:41.972049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 18:50:41.972049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 18:50:41.972049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:41.972049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 408/806] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Jul 14 18:50:41 2022] POST /identity/v3/users => generated 160 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:41.972584 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df407ebe-e869-43b6-b547-2ceeccc2102f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:42.069453 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df407ebe-e869-43b6-b547-2ceeccc2102f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:42.070956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:42.103540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e40879-1173-421e-a33c-ccfaa492fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:42.104363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e40879-1173-421e-a33c-ccfaa492fb1e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:42.104648 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e40879-1173-421e-a33c-ccfaa492fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:42.104920 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e40879-1173-421e-a33c-ccfaa492fb1e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:42.111794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e40879-1173-421e-a33c-ccfaa492fb1e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:42.113759 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e40879-1173-421e-a33c-ccfaa492fb1e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-42e40879-1173-421e-a33c-ccfaa492fb1e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:50:42.128784 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:42.129886 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:42.130826 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 399/807] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:50:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:42.136062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:42.233115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4040586-0470-40ba-a177-d4f5f820b021 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:42.250139 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:42.271543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d41ab4-2f9d-40e7-9259-8b28226d694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:42.272314 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41ab4-2f9d-40e7-9259-8b28226d694e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:42.272605 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41ab4-2f9d-40e7-9259-8b28226d694e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:42.272886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41ab4-2f9d-40e7-9259-8b28226d694e None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:42.273730 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d41ab4-2f9d-40e7-9259-8b28226d694e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:42.274085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d41ab4-2f9d-40e7-9259-8b28226d694e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:42.275765 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d41ab4-2f9d-40e7-9259-8b28226d694e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:42.314812 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 409/808] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Jul 14 18:50:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:43.350272 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6c76-2837-4bab-abf1-aaba135a0fac None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:43.350761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6c76-2837-4bab-abf1-aaba135a0fac None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:43.350852 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6c76-2837-4bab-abf1-aaba135a0fac None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:43.352143 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 400/809] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:43.357326 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c272-5a2f-404d-afd6-c6fd19f172de None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:43.357705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c272-5a2f-404d-afd6-c6fd19f172de None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:43.357893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c272-5a2f-404d-afd6-c6fd19f172de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:43.374950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-5f38c272-5a2f-404d-afd6-c6fd19f172de None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:43.376503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-5f38c272-5a2f-404d-afd6-c6fd19f172de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:43.441904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 410/810] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:43 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 18:50:43.464939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6c76-2837-4bab-abf1-aaba135a0fac None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:43.567405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6c76-2837-4bab-abf1-aaba135a0fac None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:43.600706 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:43.601488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:43.601776 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:43.602201 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:43.602861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:43.604242 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:43.616442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:43.617598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:50:43.618635 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 401/811] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:43.623556 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38c272-5a2f-404d-afd6-c6fd19f172de None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:43.719178 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38c272-5a2f-404d-afd6-c6fd19f172de None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:43.726706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:43.752829 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:43.753519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:43.753803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:43.754079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:43.754792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:43.755102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:43.756492 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:43.761267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 411/812] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:43.767108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:43.795700 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:43.867525 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525df30-5e66-4dff-95ed-867791b589c3 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:43.899422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:43.900063 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:43.900375 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:43.900649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:43.901341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] RBAC: Adding query filter params (type=compute) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:43.901644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:43.902990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:43.907622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 402/813] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:43.913389 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:44.010224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792122-95b7-4c7d-9714-6a96ec2e7a69 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:44.042570 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6541f-cc94-4399-92af-7b8e26faadeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:44.043217 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6541f-cc94-4399-92af-7b8e26faadeb None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:44.043503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6541f-cc94-4399-92af-7b8e26faadeb None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:44.043783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6541f-cc94-4399-92af-7b8e26faadeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:44.044594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6541f-cc94-4399-92af-7b8e26faadeb None admin] RBAC: Adding query filter params (interface=public, service_id=4a99ff18bcbe40558963216d9b4ecca9, region_id=RegionOne) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:44.044912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6541f-cc94-4399-92af-7b8e26faadeb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:44.046271 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6541f-cc94-4399-92af-7b8e26faadeb None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:44.051693 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 412/814] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Jul 14 18:50:43 2022] GET /identity/v3/endpoints?service_id=4a99ff18bcbe40558963216d9b4ecca9&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:44.057190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:44.145399 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:44.154894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f8a30-8f84-402d-b2c4-4886b1ffbbeb None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:44.188005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5ef4a-0e8e-4ebc-9652-9871206dc624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:44.188685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ef4a-0e8e-4ebc-9652-9871206dc624 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:44.188975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ef4a-0e8e-4ebc-9652-9871206dc624 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:44.189257 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5ef4a-0e8e-4ebc-9652-9871206dc624 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:44.189930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5ef4a-0e8e-4ebc-9652-9871206dc624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:44.191317 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5ef4a-0e8e-4ebc-9652-9871206dc624 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:44.197445 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 403/815] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Jul 14 18:50:44 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:50:46.359651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022e33-a514-4758-9dde-b83a06bec368 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:46.360123 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022e33-a514-4758-9dde-b83a06bec368 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:46.360259 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022e33-a514-4758-9dde-b83a06bec368 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:46.361591 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 413/816] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:50:46.367369 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d96de-d62e-40a1-9f31-115579716cf6 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:46.367780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d96de-d62e-40a1-9f31-115579716cf6 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:46.367929 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d96de-d62e-40a1-9f31-115579716cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:46.384320 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-e90d96de-d62e-40a1-9f31-115579716cf6 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:50:46.385494 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-e90d96de-d62e-40a1-9f31-115579716cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:50:46.450532 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 404/817] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:50:46 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:50:46.474852 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7022e33-a514-4758-9dde-b83a06bec368 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:46.509115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:46.574066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7022e33-a514-4758-9dde-b83a06bec368 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:46.606297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:46.607071 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:46.607358 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:46.607628 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:46.608296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:46.609649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:50:46.621706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:50:46.622870 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:50:46.623918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 414/818] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:50:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:50:46.628856 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d96de-d62e-40a1-9f31-115579716cf6 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:46.709401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:46.725568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d96de-d62e-40a1-9f31-115579716cf6 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:46.757828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:46.758618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:46.758906 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:46.759183 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:46.759882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:46.760190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:46.761585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:46.766427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 405/819] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:46.772655 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:46.870295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:46.874244 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69024a-c4d4-4177-8bca-ac4f994bf4fe None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:46.907267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8be31-4fb1-45d5-8ec7-bf9a59cf9a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:46.907917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8be31-4fb1-45d5-8ec7-bf9a59cf9a0f None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:46.908216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8be31-4fb1-45d5-8ec7-bf9a59cf9a0f None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:46.908515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8be31-4fb1-45d5-8ec7-bf9a59cf9a0f None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:46.909218 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8be31-4fb1-45d5-8ec7-bf9a59cf9a0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:50:46.909579 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8be31-4fb1-45d5-8ec7-bf9a59cf9a0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:46.910945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8be31-4fb1-45d5-8ec7-bf9a59cf9a0f None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:46.915659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 415/820] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Jul 14 18:50:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:50:46.921522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:50:47.018543 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a788032-1553-4836-8f23-f130e563cf77 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:50:47.051281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c70f9-7fb6-43c8-b936-746e4278d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:50:47.051922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c70f9-7fb6-43c8-b936-746e4278d421 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:50:47.052239 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c70f9-7fb6-43c8-b936-746e4278d421 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:50:47.052503 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c70f9-7fb6-43c8-b936-746e4278d421 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:50:47.053237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c70f9-7fb6-43c8-b936-746e4278d421 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:50:47.054586 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c70f9-7fb6-43c8-b936-746e4278d421 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:50:47.072021 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 406/821] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Jul 14 18:50:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:50:56.913268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=19 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:50:57.067909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:47.286087 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c35b9-b8e8-4396-bd70-82347a76cbb6 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:47.286715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c35b9-b8e8-4396-bd70-82347a76cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:47.286715 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c35b9-b8e8-4396-bd70-82347a76cbb6 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:47.288180 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 416/822] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:51:47.294651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf7a5-60a7-422a-9862-1a0acb8323ca None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:47.295126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf7a5-60a7-422a-9862-1a0acb8323ca None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:47.295232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf7a5-60a7-422a-9862-1a0acb8323ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:47.313484 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-24acf7a5-60a7-422a-9862-1a0acb8323ca None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:51:47.314830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-24acf7a5-60a7-422a-9862-1a0acb8323ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:51:47.400575 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 407/823] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:51:47 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:51:47.430561 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c35b9-b8e8-4396-bd70-82347a76cbb6 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:47.562003 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c35b9-b8e8-4396-bd70-82347a76cbb6 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:47.602628 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:47.603485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:47.603902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:47.604114 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:47.615914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:47.617420 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:51:47.636017 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:47.637378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:47.638390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:51:47.638390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:51:47.638390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:47.638390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:51:47.638390 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 417/824] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:47.643950 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf7a5-60a7-422a-9862-1a0acb8323ca None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:47.759812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf7a5-60a7-422a-9862-1a0acb8323ca None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:47.797536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:47.808436 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f9e8d-4f10-44b8-a484-1b81cf6cfa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:47.809144 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f9e8d-4f10-44b8-a484-1b81cf6cfa9b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:47.809467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f9e8d-4f10-44b8-a484-1b81cf6cfa9b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:47.809781 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f9e8d-4f10-44b8-a484-1b81cf6cfa9b None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:47.810566 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f9e8d-4f10-44b8-a484-1b81cf6cfa9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:47.810905 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f9e8d-4f10-44b8-a484-1b81cf6cfa9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:47.812433 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f9e8d-4f10-44b8-a484-1b81cf6cfa9b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:47.825456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 408/825] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:47.831986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:47.906363 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:47.971228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb944192-bd1d-4d9b-af91-db4523652687 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:48.015812 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f4c3-b630-4985-bd12-870e2cc922c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:48.016661 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f4c3-b630-4985-bd12-870e2cc922c1 None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:48.017054 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f4c3-b630-4985-bd12-870e2cc922c1 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:48.017333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f4c3-b630-4985-bd12-870e2cc922c1 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:48.018602 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f4c3-b630-4985-bd12-870e2cc922c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:48.020062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f4c3-b630-4985-bd12-870e2cc922c1 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:48.041763 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 418/826] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Jul 14 18:51:47 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:51:50.386587 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4282bde-0fb9-4697-9def-427430056f1f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:50.387157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4282bde-0fb9-4697-9def-427430056f1f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:50.387157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4282bde-0fb9-4697-9def-427430056f1f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:50.388684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 409/827] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:51:50.394507 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773c9a1-1bd1-4a09-ad2b-7eecf05b3ec8 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:50.395142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773c9a1-1bd1-4a09-ad2b-7eecf05b3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:50.395304 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773c9a1-1bd1-4a09-ad2b-7eecf05b3ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:50.414669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-4773c9a1-1bd1-4a09-ad2b-7eecf05b3ec8 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:51:50.415871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-4773c9a1-1bd1-4a09-ad2b-7eecf05b3ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:51:50.499750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 419/828] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:51:50 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:51:50.524645 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4282bde-0fb9-4697-9def-427430056f1f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:50.632851 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4282bde-0fb9-4697-9def-427430056f1f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:50.672534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:50.673406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:50.673695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:50.673971 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:50.685106 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:51:50.693471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:50.694506 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:50.700335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 410/829] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:51:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:50.701140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773c9a1-1bd1-4a09-ad2b-7eecf05b3ec8 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:50.742778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:50.816455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773c9a1-1bd1-4a09-ad2b-7eecf05b3ec8 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:50.855296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:50.856285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:50.856583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:50.856859 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:50.858101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] RBAC: Adding query filter params (name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:50.858417 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:50.860230 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:50.870311 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 420/830] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:51:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:51:50.876108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:50.936858 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:51.001335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fd738-f487-4664-ab61-bb5fccdce785 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:51.041428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:51.042245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:51.042517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:51.042794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:51.054695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:51.056294 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:51:51.075218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:51.076625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:51.078068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:51:51.078068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:51:51.078068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:51.078068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:51.078068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 411/831] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:51.083324 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:51.194950 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:51.198480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ad53-5316-458a-b16e-0324c1714600 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:51.236048 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:51.237347 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:51.237606 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:51.237904 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:51.238647 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:51.238958 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:51.240366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:51.253960 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 421/832] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:51.260999 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:51.367877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:51.372756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbba4c-f84c-4bf1-afe1-33064d1817bd None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:51.409968 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:51.410773 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:51.411055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:51.411327 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:51.420170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:51.421634 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:51:51.437967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:51.439186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:51.440988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 412/833] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:51:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:51:51.446163 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:51.558908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ce5f4-13ce-43c4-9511-adda95e31a4b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:51.595159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:51.595838 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:51.596121 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:51.596426 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:51.597248 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:51.597558 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:51.598988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:51.616515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 422/834] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Jul 14 18:51:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:51.622482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:51.728048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118188-2b01-4c93-9383-4d81be506e81 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:51.766184 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:51.767257 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:51.767257 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:51.767458 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:51.798157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:51.843316 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:51.844828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:51.951898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 413/835] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:51:51 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 18:51:51.959753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:51.981781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:52.066239 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71427-a2d3-49a9-be28-1a19686f00dd None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:52.106552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:52.107339 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:52.107620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:52.107891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:52.118310 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:52.119751 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:51:52.138079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:52.145557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:52.146521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:51:52.146521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:51:52.146521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:52.146521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:51:52.146521 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 423/836] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:52.146818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:52.210155 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:52.255916 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d50fb-c889-4297-bb6e-74405e06b98a None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:52.301773 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:52.302461 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:52.302741 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:52.303012 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:52.303721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:52.304022 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:52.305433 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:52.317300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 414/837] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:51:52.325041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:52.406813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:52.439080 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1db9-f67a-4641-8d53-f3de6f8ac12e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:52.477823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:52.479235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:52.479865 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:52.480499 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:52.488801 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:52.490477 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:51:52.505750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:52.511934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:51:52.513140 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 424/838] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:51:52.514804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:52.630064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b6cd7-714a-4b93-a2c4-221b0c3b66c9 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:52.655573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:52.675914 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f69f35-71a1-4242-a9be-52a5c2a649a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:52.676626 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69f35-71a1-4242-a9be-52a5c2a649a7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:52.677016 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69f35-71a1-4242-a9be-52a5c2a649a7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:52.677992 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69f35-71a1-4242-a9be-52a5c2a649a7 None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:52.678161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f69f35-71a1-4242-a9be-52a5c2a649a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:52.678482 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f69f35-71a1-4242-a9be-52a5c2a649a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:52.680067 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f69f35-71a1-4242-a9be-52a5c2a649a7 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:52.695220 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 415/839] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:52.701377 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:52.820052 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a1790-04d1-4aa2-85eb-8f75e8eba834 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:52.851618 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:52.858752 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacfae2-4c53-4145-9661-9c0377c0e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:52.859409 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacfae2-4c53-4145-9661-9c0377c0e943 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:52.859692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacfae2-4c53-4145-9661-9c0377c0e943 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:52.859964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacfae2-4c53-4145-9661-9c0377c0e943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:52.860820 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacfae2-4c53-4145-9661-9c0377c0e943 None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=c253a979e80b4aa889db8fba1ac875f1) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:52.861129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacfae2-4c53-4145-9661-9c0377c0e943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:52.863100 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacfae2-4c53-4145-9661-9c0377c0e943 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:52.869250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 425/840] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:51:52 2022] GET /identity/v3/role_assignments?user.id=c253a979e80b4aa889db8fba1ac875f1&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:55.282403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f7b8-b55b-44d6-9664-c8d5a57ba2bd None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:55.282900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f7b8-b55b-44d6-9664-c8d5a57ba2bd None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:55.283023 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f7b8-b55b-44d6-9664-c8d5a57ba2bd None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:55.284909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 416/841] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:51:55.290305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cd6ef-7f90-41e1-b22a-48973138303e None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:55.290718 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cd6ef-7f90-41e1-b22a-48973138303e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:55.290865 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cd6ef-7f90-41e1-b22a-48973138303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:55.308988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-785cd6ef-7f90-41e1-b22a-48973138303e None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:51:55.310186 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-785cd6ef-7f90-41e1-b22a-48973138303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:51:55.386445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 426/842] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:51:55 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:51:55.413966 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f7b8-b55b-44d6-9664-c8d5a57ba2bd None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:55.528149 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f7b8-b55b-44d6-9664-c8d5a57ba2bd None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:55.563859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:55.566373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:55.566667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:55.566946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] PATH_INFO: `/v3/roles/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:55.581744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:51:55.589622 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:55.590846 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:55.592535 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 417/843] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:51:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:55.599093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cd6ef-7f90-41e1-b22a-48973138303e None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:55.714989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cd6ef-7f90-41e1-b22a-48973138303e None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:55.740754 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:55.753340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:55.754016 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:55.754298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:55.754658 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:55.755896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] RBAC: Adding query filter params (name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:55.756238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:55.757712 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:55.767454 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 427/844] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:51:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:55.773618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:55.819146 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:55.883179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec13ea8-d04d-4dcc-89e6-7886c03b247f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:55.917713 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:55.918540 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:55.919099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:55.919384 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:55.930679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:55.932235 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:51:55.950468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:55.951568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:55.952612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:51:55.952612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:51:55.952612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:55.952612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:55.952612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 418/845] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:55.957853 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:56.070047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790f9d-3630-4d59-91f4-e810d88d41ee None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:56.105094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:56.105759 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:56.106050 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:56.106330 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:56.107073 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:56.107365 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:56.108775 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:56.121778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 428/846] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:56.127521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:56.225411 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:56.234802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cae20-19d1-4bc3-8461-d21abdfeea03 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:56.271585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:56.272472 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:56.272756 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:56.273045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] PATH_INFO: `/v3/users/placement` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:56.280794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:56.282277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:51:56.299292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:56.300793 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:56.301882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 419/847] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:51:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:56.306277 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:56.356368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:56.412480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c232-44dd-4db1-ac96-df28b1efab17 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:56.459135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:56.459866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:56.460142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:56.460484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:56.461335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:56.461692 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:56.463298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:56.483235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 429/848] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Jul 14 18:51:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:56.489335 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:56.606923 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72257-96b2-47a6-8098-95058db4468b None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:56.641416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:56.643011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:56.643331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:56.643643 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:56.654312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:56.655740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:51:56.675421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:56.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:56.677307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:51:56.677307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:51:56.677307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:51:56.677307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:56.677307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 420/849] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:56.682882 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:56.792783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b919f85-3674-4def-a9f0-af1aac34f744 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:56.795703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:56.829266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:56.830546 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:56.830836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:56.831112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:56.831822 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:56.832127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:56.833529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:56.845320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 430/850] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:51:56.850936 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:56.853955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:56.973792 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2441789-40dd-46a1-939b-9743690623b7 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:57.013180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:57.013981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:57.014310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:57.014640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:57.023160 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:57.025003 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:51:57.041496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:51:57.042559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:51:57.043674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 421/851] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:51:57.050796 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:57.162083 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037db131-7452-4e35-a9c9-c2a12cb4893d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:57.198489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36658f-734b-4569-a6f3-39147da36bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:57.199185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36658f-734b-4569-a6f3-39147da36bc9 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:57.199477 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36658f-734b-4569-a6f3-39147da36bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:57.199760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36658f-734b-4569-a6f3-39147da36bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:57.200638 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36658f-734b-4569-a6f3-39147da36bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:51:57.200955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36658f-734b-4569-a6f3-39147da36bc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:57.202484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36658f-734b-4569-a6f3-39147da36bc9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:57.215184 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 431/852] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:51:57.222215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:51:57.302453 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:51:57.354049 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc6c6-3f58-43af-911c-5cd7c4deaa23 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:51:57.393850 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29cfd7-66d2-4e7f-ac3e-24da7806f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:51:57.394966 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29cfd7-66d2-4e7f-ac3e-24da7806f430 None admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:57.395213 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29cfd7-66d2-4e7f-ac3e-24da7806f430 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:57.395606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29cfd7-66d2-4e7f-ac3e-24da7806f430 None admin] PATH_INFO: `/v3/projects/f1e951324636416eb0436eea3812cafd/users/c253a979e80b4aa889db8fba1ac875f1/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:57.412221 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29cfd7-66d2-4e7f-ac3e-24da7806f430 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e951324636416eb0436eea3812cafd, user_id=c253a979e80b4aa889db8fba1ac875f1, role_id=5c3ddf575fb24f4aaae8aad1f3e0bb10)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:51:57.413691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29cfd7-66d2-4e7f-ac3e-24da7806f430 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:51:57.426956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 422/853] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:51:57 2022] PUT /identity/v3/projects/f1e951324636416eb0436eea3812cafd/users/c253a979e80b4aa889db8fba1ac875f1/roles/5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:51:59.942391 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2cdf2-e09f-4fdf-b9a7-dbc40b30cdb7 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:59.942952 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2cdf2-e09f-4fdf-b9a7-dbc40b30cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:59.942952 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2cdf2-e09f-4fdf-b9a7-dbc40b30cdb7 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:59.944613 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 432/854] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:51:59.951432 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a43f3-6921-4ef4-abf6-f3131eec6cf2 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:51:59.951938 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a43f3-6921-4ef4-abf6-f3131eec6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:51:59.952062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a43f3-6921-4ef4-abf6-f3131eec6cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:51:59.971801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-049a43f3-6921-4ef4-abf6-f3131eec6cf2 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:51:59.973620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-049a43f3-6921-4ef4-abf6-f3131eec6cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:00.056006 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 423/855] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:51:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:00.084492 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2cdf2-e09f-4fdf-b9a7-dbc40b30cdb7 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:00.110655 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:00.198282 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2cdf2-e09f-4fdf-b9a7-dbc40b30cdb7 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:00.238034 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:00.239001 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:00.239294 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:00.239651 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] PATH_INFO: `/v3/roles/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:00.253138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:52:00.263458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:00.264484 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:00.265315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 433/856] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Jul 14 18:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:00.270305 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a43f3-6921-4ef4-abf6-f3131eec6cf2 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:00.319485 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:00.383158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a43f3-6921-4ef4-abf6-f3131eec6cf2 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:00.422742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:00.423422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:00.424405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:00.424714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:00.425592 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] RBAC: Adding query filter params (name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:00.425996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:00.427654 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:00.436869 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 424/857] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Jul 14 18:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:00.443455 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:00.546156 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:00.565753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7abf-9198-4be7-b461-b4e711569831 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:00.616947 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:00.617892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:00.618181 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:00.618459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:00.631620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:00.633401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:00.655215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:00.656381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:00.657806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:00.657806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:00.657806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:00.657806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:00.657806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 434/858] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:00.663350 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:00.777864 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344fa8a-dfe8-46ac-b8a8-9f67a8fefc68 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:00.780265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:00.815768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:00.816403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:00.816688 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:00.816969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:00.817742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:00.818050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:00.819429 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:00.834617 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 425/859] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:00.840092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:00.953105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0efda-9472-4e40-89c6-125c8d8682b9 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:00.992866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:00.993666 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:00.993958 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:00.994241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] PATH_INFO: `/v3/users/placement` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:00.997253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:01.005342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:01.007279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:52:01.025834 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:01.026896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:01.027832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 435/860] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:01.033685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:01.147181 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50baa66-adfd-4058-bb53-9e079fcca97f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:01.183529 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:01.184222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:01.184517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:01.184858 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:01.185677 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:01.186018 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:01.187546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:01.206238 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 426/861] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Jul 14 18:52:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:01.212772 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:01.326459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c1304-e82e-42b6-aecd-fa6b17d62b5e None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:01.362695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:01.363384 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:01.363677 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:01.363949 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:01.433112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:01.441375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:01.443006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:01.551157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 436/862] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:52:01 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 18:52:01.557281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:01.584802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:01.669848 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5102-cfd2-4c44-9bcf-f24dfb92da08 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:01.708959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:01.709906 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:01.710289 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:01.710667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:01.721901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:01.723337 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:01.742303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:01.743456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:01.744618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:01.744618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:01.744618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:01.744618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:01.744618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 427/863] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:01.750226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:01.853966 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:01.863803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c80245-39e7-44ec-8337-f71e7f5eac3a None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:01.905678 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:01.906350 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:01.906765 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:01.907161 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:01.907886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:01.908268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:01.909648 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:01.924352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 437/864] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:52:01.930403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:02.029293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:02.057677 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b247ea-1813-496d-9f82-5c7219473b53 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:02.098977 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:02.099870 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:02.100158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:02.100479 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:02.107949 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:02.109559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:52:02.126632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:02.127662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:02.128609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 428/865] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 18:52:02.134311 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:02.244223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b21660-7046-4258-907a-4e24a7e13cbb None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:02.282838 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a32422-4fb5-49b1-8efe-8f92f4f1be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:02.284111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32422-4fb5-49b1-8efe-8f92f4f1be70 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:02.284462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32422-4fb5-49b1-8efe-8f92f4f1be70 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:02.284777 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32422-4fb5-49b1-8efe-8f92f4f1be70 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:02.285573 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a32422-4fb5-49b1-8efe-8f92f4f1be70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:02.285891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a32422-4fb5-49b1-8efe-8f92f4f1be70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:02.287346 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a32422-4fb5-49b1-8efe-8f92f4f1be70 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:02.301556 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 438/866] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:02.308072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:02.422693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f25d14-6d01-4697-b914-d6d7ca270db2 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:02.466125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367550-138a-441d-ba0a-d7129a090238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:02.466852 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367550-138a-441d-ba0a-d7129a090238 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:02.467130 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367550-138a-441d-ba0a-d7129a090238 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:02.467489 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367550-138a-441d-ba0a-d7129a090238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:02.468465 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367550-138a-441d-ba0a-d7129a090238 None admin] RBAC: Adding query filter params (role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=c253a979e80b4aa889db8fba1ac875f1) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:02.468853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367550-138a-441d-ba0a-d7129a090238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:02.472872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367550-138a-441d-ba0a-d7129a090238 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:02.473358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:02.479437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 429/867] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:52:02 2022] GET /identity/v3/role_assignments?user.id=c253a979e80b4aa889db8fba1ac875f1&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=5c3ddf575fb24f4aaae8aad1f3e0bb10 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:05.307992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7bc6f-ce9b-4612-b858-73d22422ffdf None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:05.308567 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7bc6f-ce9b-4612-b858-73d22422ffdf None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:05.308567 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7bc6f-ce9b-4612-b858-73d22422ffdf None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:05.310373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 439/868] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:52:05.315810 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e509-9355-4a80-9e12-90ebad4e940d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:05.316250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e509-9355-4a80-9e12-90ebad4e940d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:05.316443 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7e509-9355-4a80-9e12-90ebad4e940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:05.333240 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-b9a7e509-9355-4a80-9e12-90ebad4e940d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:52:05.334439 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-b9a7e509-9355-4a80-9e12-90ebad4e940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:05.405186 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 430/869] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:52:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:05.430695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7bc6f-ce9b-4612-b858-73d22422ffdf None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:05.448802 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:05.541999 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7bc6f-ce9b-4612-b858-73d22422ffdf None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:05.578615 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:05.579411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:05.579697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:05.580505 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:05.593194 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:52:05.603617 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:05.604769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:05.605800 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 440/870] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:05.611715 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e509-9355-4a80-9e12-90ebad4e940d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:05.725496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7e509-9355-4a80-9e12-90ebad4e940d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:05.758032 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:05.768468 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:05.769426 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:05.769861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:05.770313 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:05.771283 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:05.771621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:05.773158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:05.788114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 431/871] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:05.795551 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:05.878813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:05.904142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b162-a4ff-4404-859c-d62ab8bbe87b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:05.945912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:05.946934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:05.947308 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:05.947782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:05.962373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:05.963842 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:05.984530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:05.985830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:05.987167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:05.987167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:05.987167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:05.987167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:05.987167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 441/872] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:05.991693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:06.105547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3568e-8eae-4848-a95e-817b1a2610d7 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:06.140144 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:06.140861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:06.141144 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:06.141420 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:06.142324 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:06.143218 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:06.144695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:06.158249 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 432/873] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:06.164035 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:06.270831 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2b008-2c3a-475d-8037-b990326e31ac None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:06.302220 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:06.310755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:06.311578 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:06.311871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:06.312152 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:06.320417 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:06.321891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:52:06.337699 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:06.338799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:06.339760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 442/874] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:06.344981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:06.398882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:06.450400 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c187-61c2-41d8-a652-d271934c1d20 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:06.483737 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:06.484434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:06.484717 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:06.484987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:06.485815 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:06.486628 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:06.488050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:06.506387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 433/875] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Jul 14 18:52:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:06.512087 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:06.618473 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf14e-bed5-479e-97a7-35ba63099cb0 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:06.652988 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:06.653565 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:06.653858 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:06.654137 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:06.712523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:06.725294 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:06.726753 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:06.823069 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 443/876] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:52:06 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 18:52:06.828836 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:06.924878 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f2d7a-ef2f-4805-bc2a-4dc8927aec93 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:06.933572 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:06.962146 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:06.963052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:06.963377 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:06.963717 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:06.975887 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:06.977947 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:07.004812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:07.005884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:07.006956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:07.006956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:07.006956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:07.006956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:07.006956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 434/877] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:07.012352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:07.097293 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:07.109069 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e306c4c-03b3-41b9-9b89-59fe1405b26d None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:07.142367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:07.143021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:07.143309 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:07.143589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:07.144340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:07.144652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:07.146014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:07.157974 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 444/878] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:07.163611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:07.261112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5892244-74ab-4eed-8224-be43015a9004 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:07.295336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:07.296125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:07.296444 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:07.296724 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:07.303259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:07.304733 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:52:07.318831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:07.319843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:07.320955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 435/879] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:07.325889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:07.421575 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df918-3037-4519-a5f8-f2098071783b None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:07.453317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cc21e-2cda-4554-8424-ae320d4588e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:07.453956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cc21e-2cda-4554-8424-ae320d4588e7 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:07.454238 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cc21e-2cda-4554-8424-ae320d4588e7 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:07.454509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cc21e-2cda-4554-8424-ae320d4588e7 None admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:07.455925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cc21e-2cda-4554-8424-ae320d4588e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:07.456256 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cc21e-2cda-4554-8424-ae320d4588e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:07.457679 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cc21e-2cda-4554-8424-ae320d4588e7 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:07.469042 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 445/880] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:52:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:07.474833 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:07.496464 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:07.570851 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db9335-1b22-4feb-b411-535d5766c9aa None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:07.602974 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6450-3eee-4ea6-ade6-3d1b6258767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:07.603618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6450-3eee-4ea6-ade6-3d1b6258767d None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:07.603902 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6450-3eee-4ea6-ade6-3d1b6258767d None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:07.604179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6450-3eee-4ea6-ade6-3d1b6258767d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:07.605026 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6450-3eee-4ea6-ade6-3d1b6258767d None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=c253a979e80b4aa889db8fba1ac875f1) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:07.605343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6450-3eee-4ea6-ade6-3d1b6258767d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:07.606759 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6450-3eee-4ea6-ade6-3d1b6258767d None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:07.612036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 436/881] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:52:07 2022] GET /identity/v3/role_assignments?user.id=c253a979e80b4aa889db8fba1ac875f1&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:09.761888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fdbd-c873-4f6a-8127-4f32d1d0baff None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:09.762446 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fdbd-c873-4f6a-8127-4f32d1d0baff None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:09.762446 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fdbd-c873-4f6a-8127-4f32d1d0baff None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:09.763807 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 446/882] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:52:09.769708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874298eb-6a40-4b47-896f-827cbfbd5586 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:09.770105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874298eb-6a40-4b47-896f-827cbfbd5586 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:09.770276 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874298eb-6a40-4b47-896f-827cbfbd5586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:09.786768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-874298eb-6a40-4b47-896f-827cbfbd5586 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:52:09.787959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-874298eb-6a40-4b47-896f-827cbfbd5586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:09.852781 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 437/883] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:52:09 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:09.876444 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146fdbd-c873-4f6a-8127-4f32d1d0baff None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:09.887597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:09.980389 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146fdbd-c873-4f6a-8127-4f32d1d0baff None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:10.026315 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:10.027233 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:10.027764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:10.028191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:10.039357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:52:10.047319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:10.049066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:10.050362 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 447/884] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:10.055133 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874298eb-6a40-4b47-896f-827cbfbd5586 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:10.070513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:10.153433 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874298eb-6a40-4b47-896f-827cbfbd5586 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:10.186918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:10.187581 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:10.187870 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:10.188152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:10.188922 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:10.189785 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:10.191152 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:10.199051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 438/885] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:10.204798 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:10.269388 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:10.304491 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3fcc-f2b6-4a9b-92a0-adc8d8e94910 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:10.337041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:10.337830 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:10.338119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:10.338401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:10.349159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:10.350603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:10.367921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:10.369021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:10.370025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:10.370025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:10.370025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:10.370025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:10.370025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 448/886] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:10.374838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:10.449904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:10.473137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56874d-10a7-4538-abe2-3de26ed602bc None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:10.505212 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:10.505862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:10.506145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:10.506420 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:10.507134 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:10.507441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:10.508819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:10.520245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 439/887] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:10.525901 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:10.623727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0da22-6195-43c1-b395-490d35f89f41 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:10.642376 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:10.656066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:10.656871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:10.657160 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:10.657438 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:10.666043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:10.667485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:52:10.684587 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:10.685704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:10.687094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 449/888] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:10.691692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:10.788968 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02dd6f-9418-4268-94c9-c585f5fe6b14 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:10.820838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:10.821491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:10.821771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:10.822045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:10.822860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:10.823166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:10.824650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:10.827108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:10.841984 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 440/889] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Jul 14 18:52:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:52:10.848297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:10.944300 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8c5a-1a60-418c-a9d9-b9d8b599aad9 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:10.981901 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:10.982739 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:10.983020 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:10.983427 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:10.994272 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:10.995711 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:11.012774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:11.013826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:11.014908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:11.014908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:11.014908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:11.014908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:11.014908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 450/890] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:11.019648 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:11.116282 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04d22-f718-4538-9065-122158f7d43f None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:11.148002 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:11.148679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:11.148967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:11.149240 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:11.149946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:11.150250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:11.151598 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:11.162849 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 441/891] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:11.168545 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:11.201012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:11.270676 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3794ee4-74ac-4f94-8a0e-506e1281268c None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:11.304725 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:11.305533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:11.305802 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:11.306081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:11.312560 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:11.314021 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:52:11.327890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:11.328930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:11.330111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 451/892] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:11.335026 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:11.389365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:11.433677 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb280f-5d47-4126-b29d-247ddb9f018b None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:11.466104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa1e2-ffd3-4844-ad96-728e260b515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:11.466700 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa1e2-ffd3-4844-ad96-728e260b515c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:11.466988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa1e2-ffd3-4844-ad96-728e260b515c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:11.467270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa1e2-ffd3-4844-ad96-728e260b515c None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:11.468049 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa1e2-ffd3-4844-ad96-728e260b515c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:11.468394 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa1e2-ffd3-4844-ad96-728e260b515c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:11.469816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa1e2-ffd3-4844-ad96-728e260b515c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:11.482156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 442/893] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:52:11.488014 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:11.574902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:11.584246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1a6f-bf28-4d51-bb93-badab581a273 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:11.617002 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6e01d-df52-4ace-a11a-ce15e393a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:11.617871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e01d-df52-4ace-a11a-ce15e393a5a5 None admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:11.618157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e01d-df52-4ace-a11a-ce15e393a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:11.618434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e01d-df52-4ace-a11a-ce15e393a5a5 None admin] PATH_INFO: `/v3/projects/f1e951324636416eb0436eea3812cafd/users/c253a979e80b4aa889db8fba1ac875f1/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:11.620411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e01d-df52-4ace-a11a-ce15e393a5a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1e951324636416eb0436eea3812cafd, user_id=c253a979e80b4aa889db8fba1ac875f1, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:11.621836 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e01d-df52-4ace-a11a-ce15e393a5a5 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:11.633797 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 452/894] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Jul 14 18:52:11 2022] PUT /identity/v3/projects/f1e951324636416eb0436eea3812cafd/users/c253a979e80b4aa889db8fba1ac875f1/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:52:13.845385 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855a36f-d647-497b-83ba-4f2846c6fc7c None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:13.845935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855a36f-d647-497b-83ba-4f2846c6fc7c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:13.845935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855a36f-d647-497b-83ba-4f2846c6fc7c None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:13.847292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 443/895] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:52:13.852546 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c492-8559-4725-8460-4280fc5e18d9 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:13.852911 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c492-8559-4725-8460-4280fc5e18d9 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:13.853123 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c492-8559-4725-8460-4280fc5e18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:13.870006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-8fc7c492-8559-4725-8460-4280fc5e18d9 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:52:13.871194 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-8fc7c492-8559-4725-8460-4280fc5e18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:13.936146 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 453/896] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:52:13 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:13.961275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855a36f-d647-497b-83ba-4f2846c6fc7c None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:14.081314 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855a36f-d647-497b-83ba-4f2846c6fc7c None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:14.096323 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:14.116261 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:14.117048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:14.117334 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:14.117613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:14.127440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 18:52:14.135112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:14.136255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:14.137292 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 444/897] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Jul 14 18:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:14.142399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c492-8559-4725-8460-4280fc5e18d9 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:14.221596 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:14.240656 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c492-8559-4725-8460-4280fc5e18d9 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:14.273803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:14.274474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:14.274764 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:14.275049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:14.275798 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:14.276118 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:14.277529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:14.286191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 454/898] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Jul 14 18:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:14.292002 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:14.391275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ece4-b343-4064-bfee-1e77444cd1ef None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:14.424342 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:14.425115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:14.425397 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:14.425670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:14.435804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:14.437264 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:14.453771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:14.455326 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:14.461046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:14.461046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:14.461046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:14.461046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:14.461046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 445/899] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:14.461397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:14.558041 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ef22d-6fcd-4714-8c54-95e1a6b90e51 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:14.590357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:14.591007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:14.591298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:14.591580 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:14.592329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:14.592646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:14.594006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:14.605790 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 455/900] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:14.611260 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:14.638090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:14.711967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18719973-c466-459b-a42d-3a991a8d01ab None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:14.745341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:14.746117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:14.746398 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:14.746672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:14.753778 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:14.755187 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 18:52:14.769642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:14.770613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:14.771959 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 446/901] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:14.776646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:14.780494 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:14.874137 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d836ccf-45a8-4478-a5c7-a2e88b0605bf None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:14.907518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:14.908779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:14.909068 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:14.909347 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:14.910170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:14.910482 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:14.911906 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:14.929131 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 456/902] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Jul 14 18:52:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:14.935002 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:15.020149 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:15.035190 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d377dd7-2f99-4fdf-8bd7-5118ed6fda2b None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:15.068267 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:15.068914 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:15.069200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:15.069479 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:15.134871 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:15.136344 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:15.216797 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:15.233727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 447/903] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Jul 14 18:52:14 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 18:52:15.239793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:15.299778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:15.337146 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095152ba-4c52-4ff1-96d7-494ce78584c8 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:15.370341 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:15.371128 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:15.371413 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:15.371693 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:15.381902 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:15.383333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 18:52:15.400459 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:15.401542 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:15.402490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 18:52:15.402490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 18:52:15.402490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 18:52:15.402490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:15.402490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 457/904] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:15.407815 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:15.505272 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8c456-83ed-4ad3-b712-ee814f1d8a13 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:15.537568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:15.538159 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:15.538447 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:15.538727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:15.539443 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:15.539751 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:15.541128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:15.552801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 448/905] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Jul 14 18:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:15.558582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:15.654955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff4afb-fa17-4953-b4d0-efa263b36eda None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:15.668784 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:15.689416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:15.690190 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:15.690480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:15.690758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] PATH_INFO: `/v3/projects/service` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:15.697250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:15.698677 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 18:52:15.712129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:15.713067 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: ERROR keystone.server.flask.application Jul 14 18:52:15.714138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 458/906] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Jul 14 18:52:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:15.719172 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:15.765070 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:15.818571 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609a5b-b138-423b-b1e9-b941da3c434e None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:15.850457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22f9b-11c8-45a2-94e3-867b913e0967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:15.851098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22f9b-11c8-45a2-94e3-867b913e0967 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:15.851377 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22f9b-11c8-45a2-94e3-867b913e0967 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:15.851649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22f9b-11c8-45a2-94e3-867b913e0967 None admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:15.852447 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22f9b-11c8-45a2-94e3-867b913e0967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:15.852757 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22f9b-11c8-45a2-94e3-867b913e0967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:15.854171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22f9b-11c8-45a2-94e3-867b913e0967 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:15.866168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 449/907] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Jul 14 18:52:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:15.872290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:15.974991 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd17d6d-53da-4e06-9557-988a5d3c834a None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:16.007073 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc4abf-3d5c-426b-871d-45126a8cfd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:16.007723 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc4abf-3d5c-426b-871d-45126a8cfd80 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:16.008010 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc4abf-3d5c-426b-871d-45126a8cfd80 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:16.008334 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc4abf-3d5c-426b-871d-45126a8cfd80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:16.009150 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc4abf-3d5c-426b-871d-45126a8cfd80 None admin] RBAC: Adding query filter params (role.id=03bbcd5f75d045b49c031083f6d3fbce, scope.project.id=f1e951324636416eb0436eea3812cafd, user.id=c253a979e80b4aa889db8fba1ac875f1) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:16.009465 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc4abf-3d5c-426b-871d-45126a8cfd80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:16.010886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc4abf-3d5c-426b-871d-45126a8cfd80 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:16.016576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 459/908] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Jul 14 18:52:15 2022] GET /identity/v3/role_assignments?user.id=c253a979e80b4aa889db8fba1ac875f1&scope.project.id=f1e951324636416eb0436eea3812cafd&role.id=03bbcd5f75d045b49c031083f6d3fbce => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:18.240440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a736-4a29-4d7d-8613-a616d45dc038 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:18.241005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a736-4a29-4d7d-8613-a616d45dc038 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:18.241005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a736-4a29-4d7d-8613-a616d45dc038 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:18.242376 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 450/909] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:52:18.247612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea9b2-ca1e-4cc3-9dea-fb0cad89f8f3 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:18.248012 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea9b2-ca1e-4cc3-9dea-fb0cad89f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:18.248172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ea9b2-ca1e-4cc3-9dea-fb0cad89f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:18.264689 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-4a8ea9b2-ca1e-4cc3-9dea-fb0cad89f8f3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:52:18.265887 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-4a8ea9b2-ca1e-4cc3-9dea-fb0cad89f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:18.297133 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:18.333893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 460/910] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:52:18 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:18.358088 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a736-4a29-4d7d-8613-a616d45dc038 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:18.460155 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a736-4a29-4d7d-8613-a616d45dc038 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:18.467426 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:18.494120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:18.494855 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:18.495140 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:18.495414 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] PATH_INFO: `/v3/services/placement` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:18.496062 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:18.497456 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:18.509281 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:18.510450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:18.511621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 451/911] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Jul 14 18:52:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:18.516463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ea9b2-ca1e-4cc3-9dea-fb0cad89f8f3 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:18.611259 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ea9b2-ca1e-4cc3-9dea-fb0cad89f8f3 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:18.644773 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709a508-715f-4225-a403-6652636c903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:18.645772 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709a508-715f-4225-a403-6652636c903d None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:18.645940 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709a508-715f-4225-a403-6652636c903d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:18.646216 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709a508-715f-4225-a403-6652636c903d None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:18.647096 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709a508-715f-4225-a403-6652636c903d None admin] RBAC: Adding query filter params (name=placement) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:18.647530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709a508-715f-4225-a403-6652636c903d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:18.648927 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709a508-715f-4225-a403-6652636c903d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:18.654083 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 461/912] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Jul 14 18:52:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:18.660308 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:18.758412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa013a1-9f80-4bee-9620-b0ef200f7440 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:18.790930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf75b5-6022-4935-b025-dc32ce0c3cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:18.791579 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf75b5-6022-4935-b025-dc32ce0c3cc7 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:18.791867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf75b5-6022-4935-b025-dc32ce0c3cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:18.792143 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf75b5-6022-4935-b025-dc32ce0c3cc7 None admin] PATH_INFO: `/v3/services` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:18.792873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf75b5-6022-4935-b025-dc32ce0c3cc7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:18.793183 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf75b5-6022-4935-b025-dc32ce0c3cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:18.794805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf75b5-6022-4935-b025-dc32ce0c3cc7 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:18.799209 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 452/913] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Jul 14 18:52:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:21.011631 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849990e-213c-4e3f-8cfd-509647069142 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:21.012193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849990e-213c-4e3f-8cfd-509647069142 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:21.012340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849990e-213c-4e3f-8cfd-509647069142 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:21.014320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 462/914] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:52:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:52:21.019602 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f54923-1b89-4748-8e7b-58e8d711a155 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:21.020035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f54923-1b89-4748-8e7b-58e8d711a155 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:21.020168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f54923-1b89-4748-8e7b-58e8d711a155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:21.037077 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-e9f54923-1b89-4748-8e7b-58e8d711a155 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:52:21.038268 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-e9f54923-1b89-4748-8e7b-58e8d711a155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:21.064615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:21.104445 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 453/915] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:52:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:21.128101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849990e-213c-4e3f-8cfd-509647069142 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:21.158537 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:21.227406 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849990e-213c-4e3f-8cfd-509647069142 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:21.259375 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa07944-9c46-485d-aeed-367db9a7599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:21.260025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07944-9c46-485d-aeed-367db9a7599d None admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:21.260342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07944-9c46-485d-aeed-367db9a7599d None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:21.260623 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07944-9c46-485d-aeed-367db9a7599d None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:21.261351 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07944-9c46-485d-aeed-367db9a7599d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:21.262773 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07944-9c46-485d-aeed-367db9a7599d None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:21.277741 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 463/916] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Jul 14 18:52:21 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:52:23.459860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca32e5-d02b-4b8b-9eaa-d0c3a64ed4a0 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:23.460459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca32e5-d02b-4b8b-9eaa-d0c3a64ed4a0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:23.460459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca32e5-d02b-4b8b-9eaa-d0c3a64ed4a0 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:23.461795 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 454/917] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:52:23.466821 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45290-daed-4a2b-9fe5-b459004517d3 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:23.467219 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45290-daed-4a2b-9fe5-b459004517d3 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:23.467378 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45290-daed-4a2b-9fe5-b459004517d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:23.484172 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-68e45290-daed-4a2b-9fe5-b459004517d3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:52:23.485360 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-68e45290-daed-4a2b-9fe5-b459004517d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:23.554287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 464/918] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:52:23 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:23.577421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca32e5-d02b-4b8b-9eaa-d0c3a64ed4a0 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:23.676401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca32e5-d02b-4b8b-9eaa-d0c3a64ed4a0 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:23.709828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:23.710611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:23.710892 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:23.711166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] PATH_INFO: `/v3/services/placement` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:23.711806 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:23.713196 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:23.725475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:23.726687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:23.727608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 455/919] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Jul 14 18:52:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:23.732648 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45290-daed-4a2b-9fe5-b459004517d3 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:23.750507 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:23.831274 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45290-daed-4a2b-9fe5-b459004517d3 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:23.862848 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:23.863500 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:23.863782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:23.864055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:23.864781 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] RBAC: Adding query filter params (name=placement) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:23.865084 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:23.866436 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:23.871339 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 465/920] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Jul 14 18:52:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:23.877775 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:23.906066 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:23.975943 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d42ca-1a49-42e3-8654-4abb6ac7d43c None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:24.008301 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2485f3-a4bb-4719-a0c9-e1ecabe66502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:24.008955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2485f3-a4bb-4719-a0c9-e1ecabe66502 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:24.009245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2485f3-a4bb-4719-a0c9-e1ecabe66502 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:24.009525 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2485f3-a4bb-4719-a0c9-e1ecabe66502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:24.010311 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2485f3-a4bb-4719-a0c9-e1ecabe66502 None admin] RBAC: Adding query filter params (interface=public, service_id=a2b5c4fff3894ad3b15d030a70d5ef9f, region_id=RegionOne) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:24.010627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2485f3-a4bb-4719-a0c9-e1ecabe66502 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:24.011993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2485f3-a4bb-4719-a0c9-e1ecabe66502 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:24.017645 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 456/921] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Jul 14 18:52:23 2022] GET /identity/v3/endpoints?service_id=a2b5c4fff3894ad3b15d030a70d5ef9f&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:52:24.023203 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:24.101883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:24.120072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713908ed-0b95-4c36-b115-304f072a4688 None admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:24.153177 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f4711-688c-4463-a751-f7603d6dc536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:24.153820 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f4711-688c-4463-a751-f7603d6dc536 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:24.154101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f4711-688c-4463-a751-f7603d6dc536 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:24.154376 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f4711-688c-4463-a751-f7603d6dc536 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:24.155049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f4711-688c-4463-a751-f7603d6dc536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:24.156427 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f4711-688c-4463-a751-f7603d6dc536 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:24.162741 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 466/922] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Jul 14 18:52:24 2022] GET /identity/v3/services => generated 1962 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:52:26.355685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d1ce0-7ad4-48f9-9119-970bb1b69946 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:26.356211 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d1ce0-7ad4-48f9-9119-970bb1b69946 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:26.356316 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d1ce0-7ad4-48f9-9119-970bb1b69946 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:26.357624 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 457/923] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:52:26.362730 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b309-a3eb-48c9-8045-1e22edd13472 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:26.363162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b309-a3eb-48c9-8045-1e22edd13472 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:26.363290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b309-a3eb-48c9-8045-1e22edd13472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:26.380009 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-64d0b309-a3eb-48c9-8045-1e22edd13472 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:52:26.381234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-64d0b309-a3eb-48c9-8045-1e22edd13472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:52:26.445878 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 467/924] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:52:26 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 18:52:26.469814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d1ce0-7ad4-48f9-9119-970bb1b69946 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:26.560261 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:26.570302 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d1ce0-7ad4-48f9-9119-970bb1b69946 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:26.602608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:26.603403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:26.603687 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:26.603958 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] PATH_INFO: `/v3/services/placement` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:26.604634 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:26.606047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 18:52:26.618370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 18:52:26.619524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application with Lock( Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self._enter() Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application return self.creator() Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application created_value = creator( Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: ERROR keystone.server.flask.application Jul 14 18:52:26.620457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 458/925] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Jul 14 18:52:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 18:52:26.625424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b309-a3eb-48c9-8045-1e22edd13472 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:26.698935 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:26.722809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b309-a3eb-48c9-8045-1e22edd13472 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:26.755982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b88c-6553-4c4a-b7e0-f6a45348c951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:26.756685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b88c-6553-4c4a-b7e0-f6a45348c951 None admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:26.756970 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b88c-6553-4c4a-b7e0-f6a45348c951 None admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:26.757247 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b88c-6553-4c4a-b7e0-f6a45348c951 None admin] PATH_INFO: `/v3/services` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:26.757948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b88c-6553-4c4a-b7e0-f6a45348c951 None admin] RBAC: Adding query filter params (name=placement) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:52:26.758256 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b88c-6553-4c4a-b7e0-f6a45348c951 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:26.759620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b88c-6553-4c4a-b7e0-f6a45348c951 None admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:26.764633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 468/926] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Jul 14 18:52:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:52:26.770368 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:52:26.870428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3990ced-14f9-44f9-80cd-42ecac91f834 None admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:52:26.902046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63942ded-241f-47ac-849e-aa8fefaaef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:52:26.902692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942ded-241f-47ac-849e-aa8fefaaef59 None admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:52:26.902977 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942ded-241f-47ac-849e-aa8fefaaef59 None admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:52:26.903255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942ded-241f-47ac-849e-aa8fefaaef59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:52:26.903993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63942ded-241f-47ac-849e-aa8fefaaef59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:52:26.905388 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63942ded-241f-47ac-849e-aa8fefaaef59 None admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:52:26.924405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 459/927] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Jul 14 18:52:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:52:36.761755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=30 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:52:36.919548 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:53:24.816632 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c0eda-0528-4587-961d-5049ecee65e7 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:24.817210 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c0eda-0528-4587-961d-5049ecee65e7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:24.817210 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c0eda-0528-4587-961d-5049ecee65e7 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:24.820712 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 469/928] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:24.825163 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099cd1-c432-4fde-bc49-5612aaec5852 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:24.825708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099cd1-c432-4fde-bc49-5612aaec5852 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:24.825708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099cd1-c432-4fde-bc49-5612aaec5852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:24.863359 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-0e099cd1-c432-4fde-bc49-5612aaec5852 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:24.865804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-0e099cd1-c432-4fde-bc49-5612aaec5852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:24.947412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 460/929] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:25.001304 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd47b4-4011-491d-ac27-8e1aa21d73a5 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:25.001760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd47b4-4011-491d-ac27-8e1aa21d73a5 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:25.002253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd47b4-4011-491d-ac27-8e1aa21d73a5 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:25.004263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 470/930] 10.222.0.72 () {54 vars in 964 bytes} [Thu Jul 14 18:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:25.010429 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab9dfc-7e2d-4f81-9224-472ff4fd9f40 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:25.010881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab9dfc-7e2d-4f81-9224-472ff4fd9f40 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:25.011271 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab9dfc-7e2d-4f81-9224-472ff4fd9f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:25.083116 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-38ab9dfc-7e2d-4f81-9224-472ff4fd9f40 None None] MFA Rules not processed for user `a159b191ad424a8b9452cd957385b0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:25.084599 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-38ab9dfc-7e2d-4f81-9224-472ff4fd9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:25.158347 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 461/931] 10.222.0.72 () {58 vars in 1061 bytes} [Thu Jul 14 18:53:25 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:25.168628 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd47b4-4011-491d-ac27-8e1aa21d73a5 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:25.182279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd47b4-4011-491d-ac27-8e1aa21d73a5 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:25.186195 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f675128-f64c-4e2a-bcfd-586562502a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:25.186838 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675128-f64c-4e2a-bcfd-586562502a96 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:25.187179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675128-f64c-4e2a-bcfd-586562502a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:25.187481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675128-f64c-4e2a-bcfd-586562502a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:25.197982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675128-f64c-4e2a-bcfd-586562502a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:25.199458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675128-f64c-4e2a-bcfd-586562502a96 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:25.212500 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 471/932] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:27.743340 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8fadf-68d6-4898-8d47-286e2771546a None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:27.743872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8fadf-68d6-4898-8d47-286e2771546a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:27.743962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8fadf-68d6-4898-8d47-286e2771546a None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:27.745298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 462/933] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:27.751153 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a0509-2fc9-4d84-8ff8-d3bb7898727f None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:27.751559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a0509-2fc9-4d84-8ff8-d3bb7898727f None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:27.751787 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a0509-2fc9-4d84-8ff8-d3bb7898727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:27.769906 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-052a0509-2fc9-4d84-8ff8-d3bb7898727f None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:27.771104 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-052a0509-2fc9-4d84-8ff8-d3bb7898727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:27.783306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 472/934] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:27.823961 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8fadf-68d6-4898-8d47-286e2771546a None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:27.835469 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8fadf-68d6-4898-8d47-286e2771546a None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:27.838969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663f5c-534c-4352-b9d6-39997fcc001f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:27.839607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663f5c-534c-4352-b9d6-39997fcc001f service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:27.839896 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663f5c-534c-4352-b9d6-39997fcc001f service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:27.840181 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663f5c-534c-4352-b9d6-39997fcc001f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:27.849153 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663f5c-534c-4352-b9d6-39997fcc001f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:27.850585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663f5c-534c-4352-b9d6-39997fcc001f service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:27.860288 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 463/935] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:30.412316 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec411-54ae-4fc3-b679-7ed86db519fc None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:30.412838 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec411-54ae-4fc3-b679-7ed86db519fc None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:30.412956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec411-54ae-4fc3-b679-7ed86db519fc None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:30.414401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 473/936] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:30.419348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a48f92-46d1-470f-aa39-773b16d0cdb4 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:30.419740 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a48f92-46d1-470f-aa39-773b16d0cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:30.420155 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a48f92-46d1-470f-aa39-773b16d0cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:30.457072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-f9a48f92-46d1-470f-aa39-773b16d0cdb4 None None] MFA Rules not processed for user `79253e4cb8314900b37b63f77c8efa9e`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:30.458267 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-f9a48f92-46d1-470f-aa39-773b16d0cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:30.499204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=100 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:53:30.529237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 464/937] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:30 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:30.569153 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec411-54ae-4fc3-b679-7ed86db519fc None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:30.580187 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec411-54ae-4fc3-b679-7ed86db519fc None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:30.583809 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a881e-1dcc-49bb-97ee-0526f55f41f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:30.584555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a881e-1dcc-49bb-97ee-0526f55f41f7 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:30.584908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a881e-1dcc-49bb-97ee-0526f55f41f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:30.585255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a881e-1dcc-49bb-97ee-0526f55f41f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:30.595116 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a881e-1dcc-49bb-97ee-0526f55f41f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:30.596653 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a881e-1dcc-49bb-97ee-0526f55f41f7 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:30.607170 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 474/938] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:30 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:33.451055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff95a1-66e7-48d9-8d89-22737321ffd2 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:33.451579 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff95a1-66e7-48d9-8d89-22737321ffd2 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:33.451694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff95a1-66e7-48d9-8d89-22737321ffd2 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:33.453538 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 465/939] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:33.458937 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3808a-84be-4402-a9c3-b2332b398f3d None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:33.459401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3808a-84be-4402-a9c3-b2332b398f3d None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:33.459492 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3808a-84be-4402-a9c3-b2332b398f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:33.477762 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-5bf3808a-84be-4402-a9c3-b2332b398f3d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:33.478960 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-5bf3808a-84be-4402-a9c3-b2332b398f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:33.546332 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 475/940] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:33 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:33.586082 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff95a1-66e7-48d9-8d89-22737321ffd2 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:33.596485 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff95a1-66e7-48d9-8d89-22737321ffd2 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:33.599911 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef0cbd-e066-435c-818a-9723ed6c0ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:33.600583 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef0cbd-e066-435c-818a-9723ed6c0ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:33.600896 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef0cbd-e066-435c-818a-9723ed6c0ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:33.601173 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef0cbd-e066-435c-818a-9723ed6c0ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:33.610202 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef0cbd-e066-435c-818a-9723ed6c0ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:33.611632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef0cbd-e066-435c-818a-9723ed6c0ab1 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:33.621314 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 466/941] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:33 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:36.481723 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edca6-e02c-4fb6-96c5-d681b107cfd5 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:36.482285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edca6-e02c-4fb6-96c5-d681b107cfd5 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:36.482285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edca6-e02c-4fb6-96c5-d681b107cfd5 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:36.483843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 476/942] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:36.488967 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11237-5c89-4a62-b528-fff0f42df8da None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:36.489381 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11237-5c89-4a62-b528-fff0f42df8da None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:36.489534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11237-5c89-4a62-b528-fff0f42df8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:36.507125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-3ff11237-5c89-4a62-b528-fff0f42df8da None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:36.508340 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-3ff11237-5c89-4a62-b528-fff0f42df8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:36.516791 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 467/943] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:36.553828 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1edca6-e02c-4fb6-96c5-d681b107cfd5 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:36.564871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1edca6-e02c-4fb6-96c5-d681b107cfd5 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:36.568325 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76da2-9765-4a1d-8056-adbfd9c94c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:36.568957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76da2-9765-4a1d-8056-adbfd9c94c0d service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:36.569241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76da2-9765-4a1d-8056-adbfd9c94c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:36.569518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76da2-9765-4a1d-8056-adbfd9c94c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:36.578980 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76da2-9765-4a1d-8056-adbfd9c94c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:36.580538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76da2-9765-4a1d-8056-adbfd9c94c0d service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:36.590185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 477/944] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:38.834968 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384b6f0-dc7e-4df0-9f72-e6ab4d35943f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:38.835505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384b6f0-dc7e-4df0-9f72-e6ab4d35943f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:38.835505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384b6f0-dc7e-4df0-9f72-e6ab4d35943f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:38.836819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 468/945] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:38.842007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac7fbd-f7d9-4daa-ae1a-555bd9178e3b None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:38.842436 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac7fbd-f7d9-4daa-ae1a-555bd9178e3b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:38.842691 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac7fbd-f7d9-4daa-ae1a-555bd9178e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:38.860249 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-99ac7fbd-f7d9-4daa-ae1a-555bd9178e3b None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:38.861445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-99ac7fbd-f7d9-4daa-ae1a-555bd9178e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:38.869285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 478/946] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:53:38.905791 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384b6f0-dc7e-4df0-9f72-e6ab4d35943f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:38.916493 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384b6f0-dc7e-4df0-9f72-e6ab4d35943f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:38.919898 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175c6ce-a093-4788-ae82-3789777744f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:38.920819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c6ce-a093-4788-ae82-3789777744f2 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:38.921127 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c6ce-a093-4788-ae82-3789777744f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:38.921403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c6ce-a093-4788-ae82-3789777744f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:38.930216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175c6ce-a093-4788-ae82-3789777744f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:38.931641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175c6ce-a093-4788-ae82-3789777744f2 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:38.941705 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 469/947] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:41.200509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec4c5-c6e1-40f6-abe9-cd61eb791191 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:41.201056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec4c5-c6e1-40f6-abe9-cd61eb791191 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:41.201056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec4c5-c6e1-40f6-abe9-cd61eb791191 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:41.202664 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 479/948] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:41.207819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2668eb-4270-47dd-bf9f-7cf64ae6060e None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:41.208305 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2668eb-4270-47dd-bf9f-7cf64ae6060e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:41.208517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2668eb-4270-47dd-bf9f-7cf64ae6060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:41.226413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-4d2668eb-4270-47dd-bf9f-7cf64ae6060e None None] MFA Rules not processed for user `79253e4cb8314900b37b63f77c8efa9e`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:41.227590 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-4d2668eb-4270-47dd-bf9f-7cf64ae6060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:41.235818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 470/949] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:41 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:41.289482 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cb27a-95fa-45f9-bc19-e3c6eba81ff8 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:41.289772 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cb27a-95fa-45f9-bc19-e3c6eba81ff8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:41.290055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cb27a-95fa-45f9-bc19-e3c6eba81ff8 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:41.291434 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 480/950] 10.222.0.72 () {54 vars in 964 bytes} [Thu Jul 14 18:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:41.298082 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8fa42-6edb-49cf-b787-ca9d3210a2a4 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:41.298377 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8fa42-6edb-49cf-b787-ca9d3210a2a4 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:41.298661 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8fa42-6edb-49cf-b787-ca9d3210a2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:41.316437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-bcb8fa42-6edb-49cf-b787-ca9d3210a2a4 None None] MFA Rules not processed for user `a159b191ad424a8b9452cd957385b0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:41.317663 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-bcb8fa42-6edb-49cf-b787-ca9d3210a2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:41.324011 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 471/951] 10.222.0.72 () {58 vars in 1061 bytes} [Thu Jul 14 18:53:41 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:53:41.332984 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cb27a-95fa-45f9-bc19-e3c6eba81ff8 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:41.344127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cb27a-95fa-45f9-bc19-e3c6eba81ff8 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:41.347709 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505348-f69c-482f-88aa-879b067cde5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:41.348412 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505348-f69c-482f-88aa-879b067cde5b service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:41.348706 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505348-f69c-482f-88aa-879b067cde5b service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:41.348989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505348-f69c-482f-88aa-879b067cde5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:41.358005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc505348-f69c-482f-88aa-879b067cde5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:41.360102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc505348-f69c-482f-88aa-879b067cde5b service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:41.369929 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 481/952] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:41 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:44.226419 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d6fb-3a3c-44d6-9fac-84931720bcb6 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:44.227000 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d6fb-3a3c-44d6-9fac-84931720bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:44.227000 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d6fb-3a3c-44d6-9fac-84931720bcb6 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:44.228357 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 472/953] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:44.233516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955dd1-a464-4187-8fb0-6d251cb4a113 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:44.233926 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955dd1-a464-4187-8fb0-6d251cb4a113 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:44.234087 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955dd1-a464-4187-8fb0-6d251cb4a113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:44.252152 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-55955dd1-a464-4187-8fb0-6d251cb4a113 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:44.253376 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-55955dd1-a464-4187-8fb0-6d251cb4a113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:44.261423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 482/954] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:44.299206 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3d6fb-3a3c-44d6-9fac-84931720bcb6 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:44.310316 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3d6fb-3a3c-44d6-9fac-84931720bcb6 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:44.314363 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53f088-1b4c-47c6-8f58-9fd2b44acc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:44.315006 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53f088-1b4c-47c6-8f58-9fd2b44acc9e service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:44.315293 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53f088-1b4c-47c6-8f58-9fd2b44acc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:44.315573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53f088-1b4c-47c6-8f58-9fd2b44acc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:44.324841 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53f088-1b4c-47c6-8f58-9fd2b44acc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:44.326277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53f088-1b4c-47c6-8f58-9fd2b44acc9e service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:44.336445 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 473/955] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:46.608176 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7673a-3d14-4218-80fc-b09b40de9f53 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:46.608756 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7673a-3d14-4218-80fc-b09b40de9f53 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:46.608756 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7673a-3d14-4218-80fc-b09b40de9f53 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:46.610693 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 483/956] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:46.615973 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952228d6-40d2-4ece-8a72-cb814a1e0774 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:46.616411 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952228d6-40d2-4ece-8a72-cb814a1e0774 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:46.616574 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952228d6-40d2-4ece-8a72-cb814a1e0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:46.634137 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-952228d6-40d2-4ece-8a72-cb814a1e0774 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:46.635346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-952228d6-40d2-4ece-8a72-cb814a1e0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:46.643054 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 474/957] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:46.684576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7673a-3d14-4218-80fc-b09b40de9f53 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:46.695392 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7673a-3d14-4218-80fc-b09b40de9f53 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:46.698989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438b3fd-1c0d-45ff-a67f-095299dc8371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:46.699630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438b3fd-1c0d-45ff-a67f-095299dc8371 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:46.699917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438b3fd-1c0d-45ff-a67f-095299dc8371 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:46.700208 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438b3fd-1c0d-45ff-a67f-095299dc8371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:46.709736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438b3fd-1c0d-45ff-a67f-095299dc8371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:46.711174 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438b3fd-1c0d-45ff-a67f-095299dc8371 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:46.721408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 484/958] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:49.279291 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef776a3-ea1f-4656-9b03-b5da131cb33f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:49.279707 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef776a3-ea1f-4656-9b03-b5da131cb33f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:49.279843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef776a3-ea1f-4656-9b03-b5da131cb33f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:49.281987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 475/959] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:49.287408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2c557-4001-4410-8fb7-873734121580 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:49.287826 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2c557-4001-4410-8fb7-873734121580 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:49.287994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2c557-4001-4410-8fb7-873734121580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:49.294068 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=71 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:53:49.306528 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-82b2c557-4001-4410-8fb7-873734121580 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:49.307733 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-82b2c557-4001-4410-8fb7-873734121580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:49.316335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 485/960] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:49 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:53:49.352920 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef776a3-ea1f-4656-9b03-b5da131cb33f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:49.363470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef776a3-ea1f-4656-9b03-b5da131cb33f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:49.366969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06923373-9aa5-4a71-9f24-6bc1320900a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:49.367597 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923373-9aa5-4a71-9f24-6bc1320900a4 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:49.367883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923373-9aa5-4a71-9f24-6bc1320900a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:49.368163 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923373-9aa5-4a71-9f24-6bc1320900a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:49.377491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06923373-9aa5-4a71-9f24-6bc1320900a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:49.378961 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06923373-9aa5-4a71-9f24-6bc1320900a4 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:49.388241 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 476/961] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:49 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:53.535612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f1c4e-04e2-4cf4-9a19-31d2accd7940 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:53.536135 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f1c4e-04e2-4cf4-9a19-31d2accd7940 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:53.536359 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f1c4e-04e2-4cf4-9a19-31d2accd7940 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:53.537893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 486/962] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:53.542847 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314f7fa-586e-47d0-87d8-0b0b4ed511f3 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:53.543271 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314f7fa-586e-47d0-87d8-0b0b4ed511f3 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:53.543412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314f7fa-586e-47d0-87d8-0b0b4ed511f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:53.561201 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-b314f7fa-586e-47d0-87d8-0b0b4ed511f3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:53.562428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-b314f7fa-586e-47d0-87d8-0b0b4ed511f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:53.570037 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 477/963] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:53.609616 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f1c4e-04e2-4cf4-9a19-31d2accd7940 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:53.620011 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f1c4e-04e2-4cf4-9a19-31d2accd7940 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:53.623440 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47400e4-b75c-4d92-82fc-cdf363b5a801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:53.624103 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47400e4-b75c-4d92-82fc-cdf363b5a801 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:53.624428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47400e4-b75c-4d92-82fc-cdf363b5a801 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:53.624709 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47400e4-b75c-4d92-82fc-cdf363b5a801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:53.633425 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47400e4-b75c-4d92-82fc-cdf363b5a801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:53.634858 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47400e4-b75c-4d92-82fc-cdf363b5a801 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:53.644603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 487/964] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:53:56.688681 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528a0c0-28e3-4552-b55b-e28ffbe733ac None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:56.689210 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528a0c0-28e3-4552-b55b-e28ffbe733ac None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:56.689303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528a0c0-28e3-4552-b55b-e28ffbe733ac None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:56.690592 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 478/965] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:53:56.695806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846653-b398-47e3-826c-b3d0ee8c8876 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:56.696268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846653-b398-47e3-826c-b3d0ee8c8876 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:56.696410 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846653-b398-47e3-826c-b3d0ee8c8876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:56.715356 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-57846653-b398-47e3-826c-b3d0ee8c8876 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:53:56.716513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-57846653-b398-47e3-826c-b3d0ee8c8876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:53:56.724977 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 488/966] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:53:56 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:53:56.762643 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528a0c0-28e3-4552-b55b-e28ffbe733ac None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:53:56.773741 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528a0c0-28e3-4552-b55b-e28ffbe733ac None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:53:56.777244 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbf5c-8b49-462b-998c-803476cc828b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:53:56.777877 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbf5c-8b49-462b-998c-803476cc828b service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:53:56.778163 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbf5c-8b49-462b-998c-803476cc828b service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:53:56.778444 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbf5c-8b49-462b-998c-803476cc828b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:53:56.787862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbbf5c-8b49-462b-998c-803476cc828b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:53:56.789325 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbbf5c-8b49-462b-998c-803476cc828b service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:53:56.798918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 479/967] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:53:56 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:01.121253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aec20-fd54-419d-a118-d12ee8360516 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:01.121722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aec20-fd54-419d-a118-d12ee8360516 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:01.121813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aec20-fd54-419d-a118-d12ee8360516 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:01.123160 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 489/968] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:01.129318 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9357de-7e2d-41ba-bf94-6374654a5835 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:01.129769 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9357de-7e2d-41ba-bf94-6374654a5835 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:01.130017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9357de-7e2d-41ba-bf94-6374654a5835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:01.136257 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=57 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:54:01.149401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-0b9357de-7e2d-41ba-bf94-6374654a5835 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:01.150606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-0b9357de-7e2d-41ba-bf94-6374654a5835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:01.158799 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 480/969] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:01.198494 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aec20-fd54-419d-a118-d12ee8360516 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:01.209377 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aec20-fd54-419d-a118-d12ee8360516 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:01.212945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04252c90-5dd1-4a60-917c-8b1786f43670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:01.213610 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04252c90-5dd1-4a60-917c-8b1786f43670 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:01.213893 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04252c90-5dd1-4a60-917c-8b1786f43670 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:01.214169 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04252c90-5dd1-4a60-917c-8b1786f43670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:01.223264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04252c90-5dd1-4a60-917c-8b1786f43670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:01.224747 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04252c90-5dd1-4a60-917c-8b1786f43670 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:01.234843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 490/970] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:06.597103 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb8c8-8638-489c-8560-020abbf8c96c None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:06.598004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb8c8-8638-489c-8560-020abbf8c96c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:06.598495 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb8c8-8638-489c-8560-020abbf8c96c None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:06.600365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 481/971] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 18:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:06.605713 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e46fcb-1517-4569-9974-3c282fefa8b9 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:06.606148 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e46fcb-1517-4569-9974-3c282fefa8b9 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:06.606267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e46fcb-1517-4569-9974-3c282fefa8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:06.683915 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-11e46fcb-1517-4569-9974-3c282fefa8b9 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:06.685514 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-11e46fcb-1517-4569-9974-3c282fefa8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:06.762921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 491/972] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 18:54:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:11.099069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc2caf-4fbc-4541-86c8-79137b8736fb None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:11.099618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc2caf-4fbc-4541-86c8-79137b8736fb None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:11.099618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc2caf-4fbc-4541-86c8-79137b8736fb None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:11.101279 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 482/973] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 18:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:11.106327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1ed8-fc7e-47a7-b581-364690a71159 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:11.106774 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1ed8-fc7e-47a7-b581-364690a71159 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:11.107102 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1ed8-fc7e-47a7-b581-364690a71159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:11.126339 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-45da1ed8-fc7e-47a7-b581-364690a71159 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:11.127532 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-45da1ed8-fc7e-47a7-b581-364690a71159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:11.136241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 492/974] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 18:54:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:11.143962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=2 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:54:12.700473 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165648f-d775-4acd-b367-97c9f490e493 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:12.701114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165648f-d775-4acd-b367-97c9f490e493 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:12.701114 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165648f-d775-4acd-b367-97c9f490e493 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:12.702610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 483/975] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 18:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:12.707671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c821ab-f716-4ec5-9d0e-be748767a7d1 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:12.708066 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c821ab-f716-4ec5-9d0e-be748767a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:12.708266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c821ab-f716-4ec5-9d0e-be748767a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:12.726421 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-a9c821ab-f716-4ec5-9d0e-be748767a7d1 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:12.727614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-a9c821ab-f716-4ec5-9d0e-be748767a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:12.737157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 493/976] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 18:54:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:16.686273 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ae37-9375-4623-9c6c-a75d609a2e6c None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:16.686817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ae37-9375-4623-9c6c-a75d609a2e6c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:16.686817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ae37-9375-4623-9c6c-a75d609a2e6c None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:16.688389 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 484/977] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:16.693351 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9903-7942-46a1-bb3a-bd5554f599c3 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:16.693770 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9903-7942-46a1-bb3a-bd5554f599c3 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:16.693910 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9903-7942-46a1-bb3a-bd5554f599c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:16.712065 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-bf1f9903-7942-46a1-bb3a-bd5554f599c3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:16.713356 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-bf1f9903-7942-46a1-bb3a-bd5554f599c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:16.721711 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 494/978] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:16.780692 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad92a-d510-44db-aa8b-1eb3de57e64a None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:16.781276 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad92a-d510-44db-aa8b-1eb3de57e64a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:16.781782 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad92a-d510-44db-aa8b-1eb3de57e64a None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:16.783638 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 485/979] 10.222.0.72 () {54 vars in 961 bytes} [Thu Jul 14 18:54:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:16.792785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e7cf-1b18-4061-80ae-2973b3ec3551 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:16.793072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e7cf-1b18-4061-80ae-2973b3ec3551 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:16.793974 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e7cf-1b18-4061-80ae-2973b3ec3551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:16.837712 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-d852e7cf-1b18-4061-80ae-2973b3ec3551 None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:16.838886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-d852e7cf-1b18-4061-80ae-2973b3ec3551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:16.894098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:54:16.913414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 495/980] 10.222.0.72 () {58 vars in 1058 bytes} [Thu Jul 14 18:54:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:16.922337 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad92a-d510-44db-aa8b-1eb3de57e64a None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:16.936421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad92a-d510-44db-aa8b-1eb3de57e64a None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:16.941255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15de21-2ca0-4511-b20d-e76ee903ac99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:16.941883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15de21-2ca0-4511-b20d-e76ee903ac99 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:16.942164 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15de21-2ca0-4511-b20d-e76ee903ac99 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:16.942439 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15de21-2ca0-4511-b20d-e76ee903ac99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:16.950649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15de21-2ca0-4511-b20d-e76ee903ac99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:16.952275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15de21-2ca0-4511-b20d-e76ee903ac99 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:16.966399 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 486/981] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:19.426319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842028-fcfc-4ac3-951b-24d3fe81d3ac None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:19.426862 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842028-fcfc-4ac3-951b-24d3fe81d3ac None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:19.426862 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842028-fcfc-4ac3-951b-24d3fe81d3ac None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:19.428453 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 496/982] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:19.433500 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d56b-541c-4bed-8446-03b05eea2bc3 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:19.433910 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d56b-541c-4bed-8446-03b05eea2bc3 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:19.434069 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d56b-541c-4bed-8446-03b05eea2bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:19.454253 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-20b4d56b-541c-4bed-8446-03b05eea2bc3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:19.455399 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-20b4d56b-541c-4bed-8446-03b05eea2bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:19.463343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 487/983] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:19.508865 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04842028-fcfc-4ac3-951b-24d3fe81d3ac None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:19.523566 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04842028-fcfc-4ac3-951b-24d3fe81d3ac None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:19.528450 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e32c10-4b25-49bb-a678-29f644fcc45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:19.529092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e32c10-4b25-49bb-a678-29f644fcc45c service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:19.529382 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e32c10-4b25-49bb-a678-29f644fcc45c service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:19.529667 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e32c10-4b25-49bb-a678-29f644fcc45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:19.538327 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e32c10-4b25-49bb-a678-29f644fcc45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:19.540589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e32c10-4b25-49bb-a678-29f644fcc45c service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:19.551650 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 497/984] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:22.053351 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6459d-e844-47ef-a3bb-c53a1b6e8db3 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:22.053852 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6459d-e844-47ef-a3bb-c53a1b6e8db3 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:22.053965 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6459d-e844-47ef-a3bb-c53a1b6e8db3 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:22.055256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 488/985] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:22.060612 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f722650-2b11-4d5d-b44c-1ad08d7dc4c8 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:22.061040 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f722650-2b11-4d5d-b44c-1ad08d7dc4c8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:22.061239 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f722650-2b11-4d5d-b44c-1ad08d7dc4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:22.079487 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-3f722650-2b11-4d5d-b44c-1ad08d7dc4c8 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:22.080701 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-3f722650-2b11-4d5d-b44c-1ad08d7dc4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:22.088352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 498/986] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:22.133348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b334b-201d-4cb2-8e4e-3241fc352f52 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:22.134027 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b334b-201d-4cb2-8e4e-3241fc352f52 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:22.134027 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b334b-201d-4cb2-8e4e-3241fc352f52 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:22.135229 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 489/987] 10.222.0.72 () {54 vars in 961 bytes} [Thu Jul 14 18:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:22.141138 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4aa46-7316-4743-b603-8a9f6742cce1 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:22.141437 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4aa46-7316-4743-b603-8a9f6742cce1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:22.141810 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4aa46-7316-4743-b603-8a9f6742cce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:22.161118 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-1bd4aa46-7316-4743-b603-8a9f6742cce1 None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:22.162329 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-1bd4aa46-7316-4743-b603-8a9f6742cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:22.173520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 499/988] 10.222.0.72 () {58 vars in 1058 bytes} [Thu Jul 14 18:54:22 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:54:22.181451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b334b-201d-4cb2-8e4e-3241fc352f52 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:22.194951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b334b-201d-4cb2-8e4e-3241fc352f52 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:22.199781 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76935-a531-4dbe-a94f-03fcf358f979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:22.200452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76935-a531-4dbe-a94f-03fcf358f979 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:22.200738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76935-a531-4dbe-a94f-03fcf358f979 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:22.201525 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76935-a531-4dbe-a94f-03fcf358f979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:22.213497 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d76935-a531-4dbe-a94f-03fcf358f979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:22.215262 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d76935-a531-4dbe-a94f-03fcf358f979 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:22.230831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 490/989] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:24.594648 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e552b4-cd5c-459a-9626-b4b35f239574 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:24.595514 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e552b4-cd5c-459a-9626-b4b35f239574 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:24.596123 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e552b4-cd5c-459a-9626-b4b35f239574 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:24.598558 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 500/990] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:24.603714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb0c1e-64ed-46f7-bdf5-17cf74a4da2e None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:24.605192 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb0c1e-64ed-46f7-bdf5-17cf74a4da2e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:24.606556 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb0c1e-64ed-46f7-bdf5-17cf74a4da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:24.628762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-abbb0c1e-64ed-46f7-bdf5-17cf74a4da2e None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:24.630231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-abbb0c1e-64ed-46f7-bdf5-17cf74a4da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:24.648296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 491/991] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:24.688337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e552b4-cd5c-459a-9626-b4b35f239574 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:24.702906 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e552b4-cd5c-459a-9626-b4b35f239574 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:24.708503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab441a04-2ffd-4cc3-92f0-ab274ff50865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:24.709349 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441a04-2ffd-4cc3-92f0-ab274ff50865 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:24.709793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441a04-2ffd-4cc3-92f0-ab274ff50865 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:24.710324 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441a04-2ffd-4cc3-92f0-ab274ff50865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:24.720934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab441a04-2ffd-4cc3-92f0-ab274ff50865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:24.723377 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab441a04-2ffd-4cc3-92f0-ab274ff50865 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:24.734561 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 501/992] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:26.670610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666ad8f-e79f-4faa-8c96-494761f42b18 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:26.672757 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666ad8f-e79f-4faa-8c96-494761f42b18 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:26.674167 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666ad8f-e79f-4faa-8c96-494761f42b18 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:26.689782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619b82-be51-49aa-a650-85f489c4858e None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:26.691892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619b82-be51-49aa-a650-85f489c4858e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:26.693336 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619b82-be51-49aa-a650-85f489c4858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:26.700524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 492/993] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:26 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:26.746636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-03619b82-be51-49aa-a650-85f489c4858e None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:26.748752 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-03619b82-be51-49aa-a650-85f489c4858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:26.776793 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 502/994] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:27.088058 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9880b9-d242-44da-a58a-d4be7537fcac None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:27.088457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9880b9-d242-44da-a58a-d4be7537fcac None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:27.088798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9880b9-d242-44da-a58a-d4be7537fcac None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:27.090404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 493/995] 10.222.0.72 () {54 vars in 963 bytes} [Thu Jul 14 18:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:27.095655 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d472-3635-47ef-b835-a37efbb660e2 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:27.096013 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d472-3635-47ef-b835-a37efbb660e2 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:27.096396 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d472-3635-47ef-b835-a37efbb660e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:27.127229 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d85e-8199-4183-a90f-bdcdab841f3f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:27.127561 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d85e-8199-4183-a90f-bdcdab841f3f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:27.127803 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d85e-8199-4183-a90f-bdcdab841f3f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:27.129655 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 494/996] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:27.134046 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-2601d472-3635-47ef-b835-a37efbb660e2 None None] MFA Rules not processed for user `de739f19f30b4f0ba2c90c96429537d8`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:27.134699 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeffe7-03f7-461a-a351-4e449a62ea5b None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:27.135277 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-2601d472-3635-47ef-b835-a37efbb660e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:27.135424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeffe7-03f7-461a-a351-4e449a62ea5b None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:27.135611 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeffe7-03f7-461a-a351-4e449a62ea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:27.155440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-8feeffe7-03f7-461a-a351-4e449a62ea5b None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:27.156907 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-8feeffe7-03f7-461a-a351-4e449a62ea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:27.165245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 495/997] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:54:27.208481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 503/998] 10.222.0.72 () {58 vars in 1060 bytes} [Thu Jul 14 18:54:27 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:27.212238 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feeffe7-03f7-461a-a351-4e449a62ea5b None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:27.215782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601d472-3635-47ef-b835-a37efbb660e2 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:27.224090 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601d472-3635-47ef-b835-a37efbb660e2 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:27.225455 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feeffe7-03f7-461a-a351-4e449a62ea5b None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:27.227867 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2790545-85d1-4cc4-8534-821efc58827f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de739f19f30b4f0ba2c90c96429537d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:27.228534 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790545-85d1-4cc4-8534-821efc58827f service cinder] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:27.228823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790545-85d1-4cc4-8534-821efc58827f service cinder] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:27.229100 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790545-85d1-4cc4-8534-821efc58827f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:27.230777 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2734c-b0d8-49f1-9299-2d38ac9d5f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:27.231491 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2734c-b0d8-49f1-9299-2d38ac9d5f41 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:27.231908 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2734c-b0d8-49f1-9299-2d38ac9d5f41 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:27.232215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2734c-b0d8-49f1-9299-2d38ac9d5f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:27.238469 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2790545-85d1-4cc4-8534-821efc58827f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:27.239905 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2790545-85d1-4cc4-8534-821efc58827f service cinder] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:27.241268 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2734c-b0d8-49f1-9299-2d38ac9d5f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:27.242883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2734c-b0d8-49f1-9299-2d38ac9d5f41 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:27.249603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 504/999] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:54:27.253704 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 496/1000] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:29.522934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5eff8-ebcc-4c82-9c1c-7d63aafdd7c9 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:29.522934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5eff8-ebcc-4c82-9c1c-7d63aafdd7c9 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:29.523436 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5eff8-ebcc-4c82-9c1c-7d63aafdd7c9 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:29.524654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 505/1001] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:29.530488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074f9b-bc99-43cc-bc57-e32205cc9f18 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:29.531230 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074f9b-bc99-43cc-bc57-e32205cc9f18 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:29.531513 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f074f9b-bc99-43cc-bc57-e32205cc9f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:29.550191 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-1f074f9b-bc99-43cc-bc57-e32205cc9f18 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:29.551379 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-1f074f9b-bc99-43cc-bc57-e32205cc9f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:29.559684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 497/1002] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:29.605734 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5eff8-ebcc-4c82-9c1c-7d63aafdd7c9 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:29.619585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5eff8-ebcc-4c82-9c1c-7d63aafdd7c9 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:29.625446 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a82f-a3ef-42a1-a821-48d44e90eca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:29.626093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a82f-a3ef-42a1-a821-48d44e90eca6 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:29.626383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a82f-a3ef-42a1-a821-48d44e90eca6 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:29.626677 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a82f-a3ef-42a1-a821-48d44e90eca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:29.635643 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2a82f-a3ef-42a1-a821-48d44e90eca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:29.637787 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2a82f-a3ef-42a1-a821-48d44e90eca6 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:29.648272 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 506/1003] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:31.932524 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4627c5-f4df-481c-b021-7d7a200afb85 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:31.933048 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4627c5-f4df-481c-b021-7d7a200afb85 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:31.933130 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4627c5-f4df-481c-b021-7d7a200afb85 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:31.936296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 498/1004] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:31.940137 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba47c9-6087-4999-9c0c-b32ffe0565ae None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:31.940639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba47c9-6087-4999-9c0c-b32ffe0565ae None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:31.940722 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba47c9-6087-4999-9c0c-b32ffe0565ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:31.958948 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-0dba47c9-6087-4999-9c0c-b32ffe0565ae None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:31.961569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-0dba47c9-6087-4999-9c0c-b32ffe0565ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:31.972874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 507/1005] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:32.015618 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4627c5-f4df-481c-b021-7d7a200afb85 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:32.030311 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4627c5-f4df-481c-b021-7d7a200afb85 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:32.035485 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fbdce-b0b5-454f-b0b6-1e6ce2e2455d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:32.036244 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fbdce-b0b5-454f-b0b6-1e6ce2e2455d service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:32.036694 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fbdce-b0b5-454f-b0b6-1e6ce2e2455d service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:32.037055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fbdce-b0b5-454f-b0b6-1e6ce2e2455d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:32.046912 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fbdce-b0b5-454f-b0b6-1e6ce2e2455d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:32.048517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fbdce-b0b5-454f-b0b6-1e6ce2e2455d service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:32.058354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 499/1006] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:34.289880 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d31b1-940b-436c-b2ff-cc4391347f33 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:34.290397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d31b1-940b-436c-b2ff-cc4391347f33 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:34.290730 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d31b1-940b-436c-b2ff-cc4391347f33 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:34.292795 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 508/1007] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:34.298051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301414-e8a4-4e52-b7ab-e2fad3f1f78d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:34.298473 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301414-e8a4-4e52-b7ab-e2fad3f1f78d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:34.298606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301414-e8a4-4e52-b7ab-e2fad3f1f78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:34.316963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-61301414-e8a4-4e52-b7ab-e2fad3f1f78d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:34.318145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-61301414-e8a4-4e52-b7ab-e2fad3f1f78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:34.326441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 500/1008] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:34.371555 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d31b1-940b-436c-b2ff-cc4391347f33 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:34.385750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d31b1-940b-436c-b2ff-cc4391347f33 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:34.391244 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b904c-9208-44d8-b2c7-8e7f1450a1b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:34.391889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b904c-9208-44d8-b2c7-8e7f1450a1b1 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:34.392185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b904c-9208-44d8-b2c7-8e7f1450a1b1 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:34.392504 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b904c-9208-44d8-b2c7-8e7f1450a1b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:34.401695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b904c-9208-44d8-b2c7-8e7f1450a1b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:34.403467 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b904c-9208-44d8-b2c7-8e7f1450a1b1 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:34.413393 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 509/1009] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:36.932454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323d6a-205a-42a6-861d-6c82638377f0 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:36.933175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323d6a-205a-42a6-861d-6c82638377f0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:36.933175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323d6a-205a-42a6-861d-6c82638377f0 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:36.934371 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 501/1010] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:36.940973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc3bf8-7a3f-42a5-830a-fb75482965c7 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:36.941562 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc3bf8-7a3f-42a5-830a-fb75482965c7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:36.941716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc3bf8-7a3f-42a5-830a-fb75482965c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:36.961757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-86dc3bf8-7a3f-42a5-830a-fb75482965c7 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:36.963167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-86dc3bf8-7a3f-42a5-830a-fb75482965c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:36.973196 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 510/1011] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:37.024939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323d6a-205a-42a6-861d-6c82638377f0 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:37.038517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323d6a-205a-42a6-861d-6c82638377f0 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:37.043467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125ee87-ef6d-4e32-96db-844151e0bbac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:37.044105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ee87-ef6d-4e32-96db-844151e0bbac service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:37.044924 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ee87-ef6d-4e32-96db-844151e0bbac service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:37.045207 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ee87-ef6d-4e32-96db-844151e0bbac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:37.053820 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125ee87-ef6d-4e32-96db-844151e0bbac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:37.055408 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125ee87-ef6d-4e32-96db-844151e0bbac service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:37.065804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 502/1012] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:39.529803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac910a-fcdb-4b37-a643-7aa697a61b8b None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:39.530685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac910a-fcdb-4b37-a643-7aa697a61b8b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:39.530685 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac910a-fcdb-4b37-a643-7aa697a61b8b None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:39.531625 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 511/1013] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:39.537459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040f8ae-1da9-4b3b-bfb9-2b1c4527fa86 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:39.538453 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040f8ae-1da9-4b3b-bfb9-2b1c4527fa86 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:39.538453 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040f8ae-1da9-4b3b-bfb9-2b1c4527fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:39.556020 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-b040f8ae-1da9-4b3b-bfb9-2b1c4527fa86 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:39.557252 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-b040f8ae-1da9-4b3b-bfb9-2b1c4527fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:39.565735 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 503/1014] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:39.611573 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac910a-fcdb-4b37-a643-7aa697a61b8b None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:39.629182 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac910a-fcdb-4b37-a643-7aa697a61b8b None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:39.635519 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3a575-3abf-4954-878c-a92e389bbeb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:39.636439 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3a575-3abf-4954-878c-a92e389bbeb4 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:39.637074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3a575-3abf-4954-878c-a92e389bbeb4 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:39.637456 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3a575-3abf-4954-878c-a92e389bbeb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:39.649110 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3a575-3abf-4954-878c-a92e389bbeb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:39.651472 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3a575-3abf-4954-878c-a92e389bbeb4 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:39.664144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 512/1015] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:42.592165 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27f74d-9063-4c83-ade3-6035a62bbe8e None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:42.592850 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27f74d-9063-4c83-ade3-6035a62bbe8e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:42.592850 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27f74d-9063-4c83-ade3-6035a62bbe8e None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:42.594030 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 504/1016] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:42.599531 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaac474-07cb-422a-bb1c-b8effa7afcc1 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:42.599972 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaac474-07cb-422a-bb1c-b8effa7afcc1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:42.600108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaac474-07cb-422a-bb1c-b8effa7afcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:42.625224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-aeaac474-07cb-422a-bb1c-b8effa7afcc1 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:42.626425 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-aeaac474-07cb-422a-bb1c-b8effa7afcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:42.634218 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 513/1017] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:42.679765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27f74d-9063-4c83-ade3-6035a62bbe8e None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:42.687118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=49 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:54:42.694140 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27f74d-9063-4c83-ade3-6035a62bbe8e None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:42.699035 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bb95-895b-47bc-ad8b-ae4245399e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:42.699672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bb95-895b-47bc-ad8b-ae4245399e57 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:42.699958 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bb95-895b-47bc-ad8b-ae4245399e57 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:42.700259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bb95-895b-47bc-ad8b-ae4245399e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:42.709038 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36bb95-895b-47bc-ad8b-ae4245399e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:42.712007 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36bb95-895b-47bc-ad8b-ae4245399e57 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:42.729724 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 505/1018] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:43.029348 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e856-d200-4e69-aca2-f5e37b67a26e None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:43.029640 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e856-d200-4e69-aca2-f5e37b67a26e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:43.029920 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e856-d200-4e69-aca2-f5e37b67a26e None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:43.031297 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 514/1019] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:43.036431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d1b6-9535-4958-8cf2-7dcc79c253e8 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:43.036720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d1b6-9535-4958-8cf2-7dcc79c253e8 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:43.036993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d1b6-9535-4958-8cf2-7dcc79c253e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:43.054526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-4849d1b6-9535-4958-8cf2-7dcc79c253e8 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:43.055705 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-4849d1b6-9535-4958-8cf2-7dcc79c253e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:43.063672 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 506/1020] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:43.120593 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033cd29-52b4-412a-8d5c-80bad301aef0 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:43.120883 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033cd29-52b4-412a-8d5c-80bad301aef0 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:43.121164 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033cd29-52b4-412a-8d5c-80bad301aef0 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:43.122552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 515/1021] 10.222.0.72 () {54 vars in 963 bytes} [Thu Jul 14 18:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:43.127750 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b978-6c0e-4d84-95c5-12cae0ca5317 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:43.128115 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b978-6c0e-4d84-95c5-12cae0ca5317 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:43.128446 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b978-6c0e-4d84-95c5-12cae0ca5317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:43.165755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-f753b978-6c0e-4d84-95c5-12cae0ca5317 None None] MFA Rules not processed for user `a19eb91529e945489e4df71b2e07bd31`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:43.166956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-f753b978-6c0e-4d84-95c5-12cae0ca5317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:43.226139 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 507/1022] 10.222.0.72 () {58 vars in 1060 bytes} [Thu Jul 14 18:54:43 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:43.233608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033cd29-52b4-412a-8d5c-80bad301aef0 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:43.244187 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033cd29-52b4-412a-8d5c-80bad301aef0 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:43.247775 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee0811-210b-46a7-80b5-4e2b6118d055 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19eb91529e945489e4df71b2e07bd31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:43.248447 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0811-210b-46a7-80b5-4e2b6118d055 service glance] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:43.248736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0811-210b-46a7-80b5-4e2b6118d055 service glance] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:43.249019 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0811-210b-46a7-80b5-4e2b6118d055 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:43.258333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee0811-210b-46a7-80b5-4e2b6118d055 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:43.259843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee0811-210b-46a7-80b5-4e2b6118d055 service glance] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:43.270930 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 516/1023] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:45.031180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0bdd0-63d1-4801-885d-14d6c62791d0 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:45.031867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0bdd0-63d1-4801-885d-14d6c62791d0 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:45.031867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0bdd0-63d1-4801-885d-14d6c62791d0 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:45.033192 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 508/1024] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:45.038352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130a1e-26a8-41a6-9756-c1fbb6a41935 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:45.038829 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130a1e-26a8-41a6-9756-c1fbb6a41935 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:45.039043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40130a1e-26a8-41a6-9756-c1fbb6a41935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:45.056594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:54:45.063175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-40130a1e-26a8-41a6-9756-c1fbb6a41935 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:45.064429 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-40130a1e-26a8-41a6-9756-c1fbb6a41935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:45.072643 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 517/1025] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:54:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:45.120462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0bdd0-63d1-4801-885d-14d6c62791d0 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:54:45.132043 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0bdd0-63d1-4801-885d-14d6c62791d0 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:54:45.139316 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b0881-75b5-4694-bb12-7196893c6d0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:54:45.139963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0881-75b5-4694-bb12-7196893c6d0d service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:45.140265 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0881-75b5-4694-bb12-7196893c6d0d service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:45.140531 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b0881-75b5-4694-bb12-7196893c6d0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:45.149569 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b0881-75b5-4694-bb12-7196893c6d0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:54:45.154145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b0881-75b5-4694-bb12-7196893c6d0d service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:54:45.165270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 509/1026] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:54:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:54:55.159964 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=47 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:54:58.377657 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caaeb4-9205-4e1d-9dd3-e688e718de59 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:58.378293 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caaeb4-9205-4e1d-9dd3-e688e718de59 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:58.378293 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caaeb4-9205-4e1d-9dd3-e688e718de59 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:58.379590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 518/1027] 10.222.0.72 () {54 vars in 918 bytes} [Thu Jul 14 18:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:58.384878 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758bdb-7aca-432f-af1d-40c1e981415d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:58.385374 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758bdb-7aca-432f-af1d-40c1e981415d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:58.385514 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758bdb-7aca-432f-af1d-40c1e981415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:58.404184 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-4b758bdb-7aca-432f-af1d-40c1e981415d None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:58.405434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-4b758bdb-7aca-432f-af1d-40c1e981415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:58.413947 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 510/1028] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Jul 14 18:54:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:54:58.428001 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37473e53-da38-4f88-853d-aceff57134fb None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:58.428383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37473e53-da38-4f88-853d-aceff57134fb None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:58.428675 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37473e53-da38-4f88-853d-aceff57134fb None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:58.430029 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 519/1029] 10.222.0.72 () {54 vars in 918 bytes} [Thu Jul 14 18:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:54:58.434375 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9baf95-ccd9-4b4c-a600-38ca1723c3d9 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:54:58.434658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9baf95-ccd9-4b4c-a600-38ca1723c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:54:58.434939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9baf95-ccd9-4b4c-a600-38ca1723c3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:54:58.453183 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ad9baf95-ccd9-4b4c-a600-38ca1723c3d9 None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:54:58.454343 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ad9baf95-ccd9-4b4c-a600-38ca1723c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:54:58.462875 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 511/1030] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Jul 14 18:54:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:55:01.153656 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7924b-c5f6-42ac-aff0-d81e59180444 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:01.154263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7924b-c5f6-42ac-aff0-d81e59180444 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:01.154263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7924b-c5f6-42ac-aff0-d81e59180444 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:01.155579 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 520/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:01.160873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370075-5bed-4df1-8e18-4781a627b61b None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:01.161308 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370075-5bed-4df1-8e18-4781a627b61b None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:01.161450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370075-5bed-4df1-8e18-4781a627b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:01.180730 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-85370075-5bed-4df1-8e18-4781a627b61b None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:01.181944 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-85370075-5bed-4df1-8e18-4781a627b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:01.190370 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 512/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:01.233929 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7924b-c5f6-42ac-aff0-d81e59180444 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:01.247526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7924b-c5f6-42ac-aff0-d81e59180444 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:01.253015 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de1ba8-2997-48df-8eac-cbb75b9b237d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:01.253660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1ba8-2997-48df-8eac-cbb75b9b237d service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:01.253945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1ba8-2997-48df-8eac-cbb75b9b237d service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:01.254222 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1ba8-2997-48df-8eac-cbb75b9b237d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:01.264419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de1ba8-2997-48df-8eac-cbb75b9b237d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:01.264613 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de1ba8-2997-48df-8eac-cbb75b9b237d service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:01.274783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 521/1033] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:02.229554 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23214d-da07-416a-8977-6d9be6287413 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:02.230117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23214d-da07-416a-8977-6d9be6287413 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:02.230117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23214d-da07-416a-8977-6d9be6287413 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:02.231454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 513/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:02.236342 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd865-2b1a-4d5c-9a0b-30c52dcf5f7a None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:02.236750 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd865-2b1a-4d5c-9a0b-30c52dcf5f7a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:02.236935 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd865-2b1a-4d5c-9a0b-30c52dcf5f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:02.255262 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-100fd865-2b1a-4d5c-9a0b-30c52dcf5f7a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:02.256488 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-100fd865-2b1a-4d5c-9a0b-30c52dcf5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:02.265010 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 522/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:55:02.477460 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23214d-da07-416a-8977-6d9be6287413 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:02.491102 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23214d-da07-416a-8977-6d9be6287413 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:02.495843 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b4e98-47bb-4c03-9351-484ab877c77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:02.496499 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4e98-47bb-4c03-9351-484ab877c77e service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:02.496780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4e98-47bb-4c03-9351-484ab877c77e service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:02.497050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4e98-47bb-4c03-9351-484ab877c77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:02.505503 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b4e98-47bb-4c03-9351-484ab877c77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:02.507065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b4e98-47bb-4c03-9351-484ab877c77e service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:02.516194 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 514/1036] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:03.406571 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2bf82-88e2-4c95-b4c2-2fa3b3cd8806 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:03.407201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2bf82-88e2-4c95-b4c2-2fa3b3cd8806 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:03.407201 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2bf82-88e2-4c95-b4c2-2fa3b3cd8806 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:03.408633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 523/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:03.413718 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885f17-a100-4c4b-8cff-62b883d69cef None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:03.414163 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885f17-a100-4c4b-8cff-62b883d69cef None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:03.414270 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885f17-a100-4c4b-8cff-62b883d69cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:03.432457 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-a8885f17-a100-4c4b-8cff-62b883d69cef None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:03.433640 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-a8885f17-a100-4c4b-8cff-62b883d69cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:03.441219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 515/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:03.599112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2bf82-88e2-4c95-b4c2-2fa3b3cd8806 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:03.612381 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2bf82-88e2-4c95-b4c2-2fa3b3cd8806 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:03.617264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bcc2e-6f96-4a47-bc2c-7fa292fc2693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:03.617888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bcc2e-6f96-4a47-bc2c-7fa292fc2693 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:03.618171 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bcc2e-6f96-4a47-bc2c-7fa292fc2693 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:03.618451 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bcc2e-6f96-4a47-bc2c-7fa292fc2693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:03.629595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bcc2e-6f96-4a47-bc2c-7fa292fc2693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:03.631235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bcc2e-6f96-4a47-bc2c-7fa292fc2693 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:03.640941 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 524/1039] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:04.497406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43224-6880-4bbd-833a-86f590a471d8 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:04.497985 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43224-6880-4bbd-833a-86f590a471d8 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:04.497985 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43224-6880-4bbd-833a-86f590a471d8 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:04.499320 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 516/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:04.504287 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028b2d-a025-49ce-896a-1c069b40d05a None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:04.504727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028b2d-a025-49ce-896a-1c069b40d05a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:04.504856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028b2d-a025-49ce-896a-1c069b40d05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:04.522566 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-4b028b2d-a025-49ce-896a-1c069b40d05a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:04.523770 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-4b028b2d-a025-49ce-896a-1c069b40d05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:04.531983 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 525/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:04.683487 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43224-6880-4bbd-833a-86f590a471d8 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:04.697609 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43224-6880-4bbd-833a-86f590a471d8 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:04.703065 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62367d-eaba-4418-aef6-62f4d6b6e733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:04.703696 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62367d-eaba-4418-aef6-62f4d6b6e733 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:04.703981 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62367d-eaba-4418-aef6-62f4d6b6e733 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:04.704294 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62367d-eaba-4418-aef6-62f4d6b6e733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:04.712320 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62367d-eaba-4418-aef6-62f4d6b6e733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:04.713931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62367d-eaba-4418-aef6-62f4d6b6e733 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:04.723819 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 517/1042] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:05.588709 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62d48-8804-4f50-b622-62797fc47f4e None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:05.589235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62d48-8804-4f50-b622-62797fc47f4e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:05.589235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62d48-8804-4f50-b622-62797fc47f4e None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:05.590538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 526/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:05.596050 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbca8f-68cb-4499-a9bd-536a15ab17a5 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:05.596526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbca8f-68cb-4499-a9bd-536a15ab17a5 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:05.596631 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbca8f-68cb-4499-a9bd-536a15ab17a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:05.614128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-cefbca8f-68cb-4499-a9bd-536a15ab17a5 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:05.615312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-cefbca8f-68cb-4499-a9bd-536a15ab17a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:05.622915 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 518/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:05.776716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b62d48-8804-4f50-b622-62797fc47f4e None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:05.790705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b62d48-8804-4f50-b622-62797fc47f4e None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:05.795839 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4082a5-c827-4035-8ab4-4f85fac9c782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:05.796501 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4082a5-c827-4035-8ab4-4f85fac9c782 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:05.796786 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4082a5-c827-4035-8ab4-4f85fac9c782 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:05.797058 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4082a5-c827-4035-8ab4-4f85fac9c782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:05.804955 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4082a5-c827-4035-8ab4-4f85fac9c782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:05.806509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4082a5-c827-4035-8ab4-4f85fac9c782 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:05.816086 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 527/1045] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:06.611830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e312e-20ed-4c1b-b09c-8ab88b69f8ad None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:06.612495 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e312e-20ed-4c1b-b09c-8ab88b69f8ad None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:06.612495 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e312e-20ed-4c1b-b09c-8ab88b69f8ad None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:06.613689 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 519/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:06.618559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2964-edec-4e7e-9d0d-6d9ee8be6fdb None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:06.618969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2964-edec-4e7e-9d0d-6d9ee8be6fdb None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:06.619132 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2964-edec-4e7e-9d0d-6d9ee8be6fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:06.637229 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-addb2964-edec-4e7e-9d0d-6d9ee8be6fdb None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:06.638463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-addb2964-edec-4e7e-9d0d-6d9ee8be6fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:06.646782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 528/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:06.800634 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e312e-20ed-4c1b-b09c-8ab88b69f8ad None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:06.814564 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e312e-20ed-4c1b-b09c-8ab88b69f8ad None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:06.819441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef41e0-e497-4680-b5cf-4cc3fe37e3c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:06.820072 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef41e0-e497-4680-b5cf-4cc3fe37e3c2 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:06.820387 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef41e0-e497-4680-b5cf-4cc3fe37e3c2 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:06.820665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef41e0-e497-4680-b5cf-4cc3fe37e3c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:06.829133 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef41e0-e497-4680-b5cf-4cc3fe37e3c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:06.830713 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef41e0-e497-4680-b5cf-4cc3fe37e3c2 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:06.839875 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 520/1048] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:07.639524 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b7edb-2572-4e8e-8186-fad7e469964b None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:07.640061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b7edb-2572-4e8e-8186-fad7e469964b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:07.640061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b7edb-2572-4e8e-8186-fad7e469964b None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:07.641457 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 529/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:07.646385 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0464be6-de69-4651-9ad5-41be47f72cdb None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:07.646785 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0464be6-de69-4651-9ad5-41be47f72cdb None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:07.646946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0464be6-de69-4651-9ad5-41be47f72cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:07.664470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-a0464be6-de69-4651-9ad5-41be47f72cdb None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:07.665665 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-a0464be6-de69-4651-9ad5-41be47f72cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:07.674133 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 521/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:07.828031 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b7edb-2572-4e8e-8186-fad7e469964b None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:07.841371 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b7edb-2572-4e8e-8186-fad7e469964b None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:07.846259 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb89e5-06ab-4856-8c00-26f2ed67f8cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:07.846891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb89e5-06ab-4856-8c00-26f2ed67f8cd service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:07.847174 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb89e5-06ab-4856-8c00-26f2ed67f8cd service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:07.847452 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb89e5-06ab-4856-8c00-26f2ed67f8cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:07.855846 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb89e5-06ab-4856-8c00-26f2ed67f8cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:07.857960 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb89e5-06ab-4856-8c00-26f2ed67f8cd service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:07.867116 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 530/1051] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:08.678874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58853-0205-4d25-9f0c-0b772eabea96 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:08.679428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58853-0205-4d25-9f0c-0b772eabea96 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:08.679428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58853-0205-4d25-9f0c-0b772eabea96 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:08.680745 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 522/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:08.686229 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480692e7-2e44-4316-8edb-8015a95ca833 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:08.686669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480692e7-2e44-4316-8edb-8015a95ca833 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:08.686844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480692e7-2e44-4316-8edb-8015a95ca833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:08.704415 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-480692e7-2e44-4316-8edb-8015a95ca833 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:08.705605 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-480692e7-2e44-4316-8edb-8015a95ca833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:08.713316 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 531/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:55:08.867570 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa58853-0205-4d25-9f0c-0b772eabea96 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:08.880909 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa58853-0205-4d25-9f0c-0b772eabea96 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:08.885749 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cbd90-8f96-4d07-877f-faad1a33619e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:08.886376 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbd90-8f96-4d07-877f-faad1a33619e service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:08.886659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbd90-8f96-4d07-877f-faad1a33619e service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:08.886935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbd90-8f96-4d07-877f-faad1a33619e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:08.895046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cbd90-8f96-4d07-877f-faad1a33619e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:08.896642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cbd90-8f96-4d07-877f-faad1a33619e service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:08.906444 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 523/1054] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:09.712076 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb4f9-b947-4478-838b-c1f26d40d036 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:09.712951 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb4f9-b947-4478-838b-c1f26d40d036 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:09.713116 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb4f9-b947-4478-838b-c1f26d40d036 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:09.714580 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 532/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:09.719431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c10747-aa82-4963-91b0-5c47b0ca5d78 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:09.719844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c10747-aa82-4963-91b0-5c47b0ca5d78 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:09.719995 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c10747-aa82-4963-91b0-5c47b0ca5d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:09.737584 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-d3c10747-aa82-4963-91b0-5c47b0ca5d78 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:09.738766 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-d3c10747-aa82-4963-91b0-5c47b0ca5d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:09.746464 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 524/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:55:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:09.901899 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb4f9-b947-4478-838b-c1f26d40d036 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:09.915202 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb4f9-b947-4478-838b-c1f26d40d036 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:09.920975 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb231-3255-43da-b247-6bdf4b019237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:09.921609 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb231-3255-43da-b247-6bdf4b019237 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:09.921897 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb231-3255-43da-b247-6bdf4b019237 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:09.922176 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb231-3255-43da-b247-6bdf4b019237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:09.930344 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecb231-3255-43da-b247-6bdf4b019237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:09.931794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecb231-3255-43da-b247-6bdf4b019237 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:09.942079 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 533/1057] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:12.032735 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b722da-8f90-4062-b995-09b93cfa8899 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:12.033285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b722da-8f90-4062-b995-09b93cfa8899 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:12.033285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b722da-8f90-4062-b995-09b93cfa8899 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:12.034651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 525/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:12.039989 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b8820-8676-44f8-b7d8-75247212d7c1 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:12.040468 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b8820-8676-44f8-b7d8-75247212d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:12.040583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b8820-8676-44f8-b7d8-75247212d7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:12.058072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-9d3b8820-8676-44f8-b7d8-75247212d7c1 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:12.059266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-9d3b8820-8676-44f8-b7d8-75247212d7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:12.067450 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 534/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:12.106804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b722da-8f90-4062-b995-09b93cfa8899 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:12.117342 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b722da-8f90-4062-b995-09b93cfa8899 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:12.120780 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008289fb-0e84-4f8f-abac-2c37cc4d8a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:12.121408 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008289fb-0e84-4f8f-abac-2c37cc4d8a84 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:12.121695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008289fb-0e84-4f8f-abac-2c37cc4d8a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:12.121976 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008289fb-0e84-4f8f-abac-2c37cc4d8a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:12.131266 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008289fb-0e84-4f8f-abac-2c37cc4d8a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:12.132736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008289fb-0e84-4f8f-abac-2c37cc4d8a84 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:12.142693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 526/1060] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:14.493996 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97989e-1bf4-43d4-b00c-e8fc35a53c29 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:14.494557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97989e-1bf4-43d4-b00c-e8fc35a53c29 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:14.494557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97989e-1bf4-43d4-b00c-e8fc35a53c29 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:14.495972 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 535/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:14.501662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a461-b1d3-45a0-a81a-f0fd66680ada None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:14.502097 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a461-b1d3-45a0-a81a-f0fd66680ada None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:14.502233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3a461-b1d3-45a0-a81a-f0fd66680ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:14.520094 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ecd3a461-b1d3-45a0-a81a-f0fd66680ada None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:14.521319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ecd3a461-b1d3-45a0-a81a-f0fd66680ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:14.529811 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 527/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:14.568711 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97989e-1bf4-43d4-b00c-e8fc35a53c29 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:14.579812 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97989e-1bf4-43d4-b00c-e8fc35a53c29 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:14.583318 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc8444-6450-4bcf-90ba-411f2f2ebbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:14.583954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8444-6450-4bcf-90ba-411f2f2ebbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:14.584285 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8444-6450-4bcf-90ba-411f2f2ebbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:14.584571 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8444-6450-4bcf-90ba-411f2f2ebbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:14.594007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc8444-6450-4bcf-90ba-411f2f2ebbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:14.595470 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc8444-6450-4bcf-90ba-411f2f2ebbf6 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:14.604778 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 536/1063] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:17.242497 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02222-f97e-4d83-a4a8-fac7b8269301 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:17.243074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02222-f97e-4d83-a4a8-fac7b8269301 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:17.243074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02222-f97e-4d83-a4a8-fac7b8269301 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:17.244551 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 528/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:17.249847 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109ca6-52e8-4467-8ca3-67ffe633a636 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:17.250302 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109ca6-52e8-4467-8ca3-67ffe633a636 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:17.250416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109ca6-52e8-4467-8ca3-67ffe633a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:17.267851 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-0f109ca6-52e8-4467-8ca3-67ffe633a636 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:17.269098 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-0f109ca6-52e8-4467-8ca3-67ffe633a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:17.276867 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 537/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:17.316584 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e02222-f97e-4d83-a4a8-fac7b8269301 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:17.327261 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e02222-f97e-4d83-a4a8-fac7b8269301 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:17.330716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22477dd-8e68-429a-8f6c-49001a84a4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:17.331349 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22477dd-8e68-429a-8f6c-49001a84a4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:17.331634 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22477dd-8e68-429a-8f6c-49001a84a4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:17.331911 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22477dd-8e68-429a-8f6c-49001a84a4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:17.340872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22477dd-8e68-429a-8f6c-49001a84a4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:17.342839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22477dd-8e68-429a-8f6c-49001a84a4e1 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:17.352287 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 529/1066] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:55:19.705842 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e5152-281f-49ef-9d0a-7178f3f2658a None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:19.706396 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e5152-281f-49ef-9d0a-7178f3f2658a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:19.706396 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e5152-281f-49ef-9d0a-7178f3f2658a None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:19.707822 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 538/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:19.713229 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30610124-c1f0-48f2-82d6-84abe5e0ad3f None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:19.713641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30610124-c1f0-48f2-82d6-84abe5e0ad3f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:19.713790 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30610124-c1f0-48f2-82d6-84abe5e0ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:19.732126 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-30610124-c1f0-48f2-82d6-84abe5e0ad3f None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:19.733351 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-30610124-c1f0-48f2-82d6-84abe5e0ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:19.741113 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 530/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:19.781340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e5152-281f-49ef-9d0a-7178f3f2658a None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:19.792561 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e5152-281f-49ef-9d0a-7178f3f2658a None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:19.796252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea400-60ae-44be-b679-c53644f670c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:19.796907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea400-60ae-44be-b679-c53644f670c6 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:19.797205 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea400-60ae-44be-b679-c53644f670c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:19.797485 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea400-60ae-44be-b679-c53644f670c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:19.806157 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea400-60ae-44be-b679-c53644f670c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:19.807618 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea400-60ae-44be-b679-c53644f670c6 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:19.816758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 539/1069] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:22.102465 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449c79-0104-42c4-8303-48da0708669a None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:22.103022 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449c79-0104-42c4-8303-48da0708669a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:22.103022 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449c79-0104-42c4-8303-48da0708669a None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:22.104401 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 531/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:22.110096 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f2351-3c40-4151-9e65-caed5df4c9b5 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:22.110508 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f2351-3c40-4151-9e65-caed5df4c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:22.110644 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f2351-3c40-4151-9e65-caed5df4c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:22.128622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-eb2f2351-3c40-4151-9e65-caed5df4c9b5 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:22.129832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-eb2f2351-3c40-4151-9e65-caed5df4c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:22.137677 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 540/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:22.176403 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49449c79-0104-42c4-8303-48da0708669a None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:22.188104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49449c79-0104-42c4-8303-48da0708669a None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:22.191496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570be4e-e0b9-45e1-b6ae-13f334155aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:22.192128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be4e-e0b9-45e1-b6ae-13f334155aec service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:22.192441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be4e-e0b9-45e1-b6ae-13f334155aec service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:22.192719 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be4e-e0b9-45e1-b6ae-13f334155aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:22.201462 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570be4e-e0b9-45e1-b6ae-13f334155aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:22.202887 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570be4e-e0b9-45e1-b6ae-13f334155aec service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:22.212128 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 532/1072] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:24.498817 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bdfe9-c4a5-41ea-8f47-b52fd82117c9 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:24.499368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bdfe9-c4a5-41ea-8f47-b52fd82117c9 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:24.499368 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bdfe9-c4a5-41ea-8f47-b52fd82117c9 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:24.500782 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 541/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:24.505937 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2ad3-fc83-4c96-ba49-d224801ca201 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:24.506383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2ad3-fc83-4c96-ba49-d224801ca201 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:24.506497 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2ad3-fc83-4c96-ba49-d224801ca201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:24.524159 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-eb7f2ad3-fc83-4c96-ba49-d224801ca201 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:24.525481 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-eb7f2ad3-fc83-4c96-ba49-d224801ca201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:24.534412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 533/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:24.572716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bdfe9-c4a5-41ea-8f47-b52fd82117c9 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:24.584143 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bdfe9-c4a5-41ea-8f47-b52fd82117c9 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:24.587646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88574f42-7ed5-4803-bbb2-6b84ef57d010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:24.588319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574f42-7ed5-4803-bbb2-6b84ef57d010 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:24.588613 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574f42-7ed5-4803-bbb2-6b84ef57d010 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:24.588894 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574f42-7ed5-4803-bbb2-6b84ef57d010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:24.597714 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88574f42-7ed5-4803-bbb2-6b84ef57d010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:24.599142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88574f42-7ed5-4803-bbb2-6b84ef57d010 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:24.608907 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 542/1075] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:26.879499 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3f4e9-d05d-4008-9555-522fe108182d None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:26.880024 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3f4e9-d05d-4008-9555-522fe108182d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:26.880141 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3f4e9-d05d-4008-9555-522fe108182d None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:26.881438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 534/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:26.886866 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ea88a-6571-4bde-9307-5ed52e6b103e None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:26.887320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ea88a-6571-4bde-9307-5ed52e6b103e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:26.887429 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ea88a-6571-4bde-9307-5ed52e6b103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:26.893594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=70 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:55:26.907424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-b35ea88a-6571-4bde-9307-5ed52e6b103e None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:26.908657 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-b35ea88a-6571-4bde-9307-5ed52e6b103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:26.916489 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 543/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:26.955835 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3f4e9-d05d-4008-9555-522fe108182d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:26.961179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=73 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:55:26.967815 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3f4e9-d05d-4008-9555-522fe108182d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:26.971352 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29638f3-ee6a-4d00-a397-693860009dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:26.972020 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29638f3-ee6a-4d00-a397-693860009dcb service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:26.972341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29638f3-ee6a-4d00-a397-693860009dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:26.972674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29638f3-ee6a-4d00-a397-693860009dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:26.982309 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29638f3-ee6a-4d00-a397-693860009dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:26.983727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29638f3-ee6a-4d00-a397-693860009dcb service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:26.992982 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 535/1078] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:29.258010 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327ae0-bbe0-4baf-bf39-7355de718722 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:29.258522 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327ae0-bbe0-4baf-bf39-7355de718722 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:29.258625 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327ae0-bbe0-4baf-bf39-7355de718722 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:29.259937 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 544/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:29.265239 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244524b1-2125-465a-a3ee-ca9061dcc23d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:29.265684 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244524b1-2125-465a-a3ee-ca9061dcc23d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:29.265786 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244524b1-2125-465a-a3ee-ca9061dcc23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:29.283894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-244524b1-2125-465a-a3ee-ca9061dcc23d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:29.285161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-244524b1-2125-465a-a3ee-ca9061dcc23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:29.292982 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 536/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:29.332760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b327ae0-bbe0-4baf-bf39-7355de718722 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:29.344074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b327ae0-bbe0-4baf-bf39-7355de718722 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:29.347528 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dcf20-6af0-41c5-acb9-4ea5f1179c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:29.348154 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dcf20-6af0-41c5-acb9-4ea5f1179c58 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:29.348464 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dcf20-6af0-41c5-acb9-4ea5f1179c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:29.348737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dcf20-6af0-41c5-acb9-4ea5f1179c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:29.358127 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dcf20-6af0-41c5-acb9-4ea5f1179c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:29.359540 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dcf20-6af0-41c5-acb9-4ea5f1179c58 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:29.368679 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 545/1081] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:31.561559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92143db-edc0-4ca2-b89d-67b845e93d8e None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:31.562089 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92143db-edc0-4ca2-b89d-67b845e93d8e None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:31.562089 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92143db-edc0-4ca2-b89d-67b845e93d8e None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:31.563373 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 537/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:31.568702 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3aac-aea4-42e9-b422-655939417712 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:31.569150 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3aac-aea4-42e9-b422-655939417712 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:31.569264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3aac-aea4-42e9-b422-655939417712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:31.586921 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-e9bf3aac-aea4-42e9-b422-655939417712 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:31.588111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-e9bf3aac-aea4-42e9-b422-655939417712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:31.595856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 546/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:31.633733 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92143db-edc0-4ca2-b89d-67b845e93d8e None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:31.645105 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92143db-edc0-4ca2-b89d-67b845e93d8e None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:31.648619 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3761d1-9d72-4ee8-b6be-87f46ba3a120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:31.649279 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3761d1-9d72-4ee8-b6be-87f46ba3a120 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:31.649565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3761d1-9d72-4ee8-b6be-87f46ba3a120 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:31.649868 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3761d1-9d72-4ee8-b6be-87f46ba3a120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:31.658757 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3761d1-9d72-4ee8-b6be-87f46ba3a120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:31.660234 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3761d1-9d72-4ee8-b6be-87f46ba3a120 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:31.670061 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 538/1084] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:33.870662 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb1b7-4368-4170-9915-a291c1239af1 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:33.871224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb1b7-4368-4170-9915-a291c1239af1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:33.871224 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb1b7-4368-4170-9915-a291c1239af1 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:33.872636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 547/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:33.877823 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b703-d978-4ed8-b3e7-f4ebec032a8a None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:33.878247 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b703-d978-4ed8-b3e7-f4ebec032a8a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:33.878380 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b703-d978-4ed8-b3e7-f4ebec032a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:33.896238 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-f1b8b703-d978-4ed8-b3e7-f4ebec032a8a None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:33.897426 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-f1b8b703-d978-4ed8-b3e7-f4ebec032a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:33.905794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 539/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:55:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:55:33.942403 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb1b7-4368-4170-9915-a291c1239af1 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:33.953748 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb1b7-4368-4170-9915-a291c1239af1 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:33.957193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0be6e-40b5-4f79-835e-f655c8e43ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:33.957827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0be6e-40b5-4f79-835e-f655c8e43ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:33.958105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0be6e-40b5-4f79-835e-f655c8e43ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:33.958377 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0be6e-40b5-4f79-835e-f655c8e43ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:33.967620 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0be6e-40b5-4f79-835e-f655c8e43ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:33.969074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0be6e-40b5-4f79-835e-f655c8e43ff7 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:33.978547 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 548/1087] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:55:43.891256 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=17 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:55:43.974389 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=17 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:55:57.312275 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751ace9-043c-4e39-be22-35794c9868b7 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:57.312743 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751ace9-043c-4e39-be22-35794c9868b7 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:57.312847 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751ace9-043c-4e39-be22-35794c9868b7 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:57.314198 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 540/1088] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:57.319252 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd9c5-2977-4c2d-910d-07e4b663eac9 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:57.319660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd9c5-2977-4c2d-910d-07e4b663eac9 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:57.319812 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd9c5-2977-4c2d-910d-07e4b663eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:57.337590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-5dfdd9c5-2977-4c2d-910d-07e4b663eac9 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:57.338776 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-5dfdd9c5-2977-4c2d-910d-07e4b663eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:57.347129 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 549/1089] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:55:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:57.396828 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819f702-a434-45bd-b4a9-562596062728 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:57.397117 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819f702-a434-45bd-b4a9-562596062728 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:57.397394 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819f702-a434-45bd-b4a9-562596062728 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:57.398716 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 541/1090] 10.222.0.72 () {54 vars in 963 bytes} [Thu Jul 14 18:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:57.405545 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb1f4-a4b1-4b49-908a-fb6c3caea549 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:57.405837 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb1f4-a4b1-4b49-908a-fb6c3caea549 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:57.406119 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb1f4-a4b1-4b49-908a-fb6c3caea549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:57.424458 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-811bb1f4-a4b1-4b49-908a-fb6c3caea549 None None] MFA Rules not processed for user `a19eb91529e945489e4df71b2e07bd31`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:57.425635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-811bb1f4-a4b1-4b49-908a-fb6c3caea549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:57.431985 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 550/1091] 10.222.0.72 () {58 vars in 1060 bytes} [Thu Jul 14 18:55:57 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:57.439603 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819f702-a434-45bd-b4a9-562596062728 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:57.450038 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819f702-a434-45bd-b4a9-562596062728 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:57.453526 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea331ccc-9455-400d-8c2a-8f8ccc66b5b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19eb91529e945489e4df71b2e07bd31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:57.454145 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea331ccc-9455-400d-8c2a-8f8ccc66b5b9 service glance] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:57.454427 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea331ccc-9455-400d-8c2a-8f8ccc66b5b9 service glance] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:57.454705 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea331ccc-9455-400d-8c2a-8f8ccc66b5b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:57.463398 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea331ccc-9455-400d-8c2a-8f8ccc66b5b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:57.464884 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea331ccc-9455-400d-8c2a-8f8ccc66b5b9 service glance] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:57.474033 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 542/1092] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:55:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:55:59.767982 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525c25-c1f8-4ea0-a323-da0047a3d741 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:59.768601 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525c25-c1f8-4ea0-a323-da0047a3d741 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:59.768601 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525c25-c1f8-4ea0-a323-da0047a3d741 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:59.769961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 551/1093] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:55:59.774950 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348a49-73ea-400e-a8de-550f07f5bcee None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:59.775384 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348a49-73ea-400e-a8de-550f07f5bcee None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:59.775512 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348a49-73ea-400e-a8de-550f07f5bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:59.793654 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-19348a49-73ea-400e-a8de-550f07f5bcee None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:55:59.794836 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-19348a49-73ea-400e-a8de-550f07f5bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:55:59.802765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 543/1094] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:55:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:55:59.827318 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525c25-c1f8-4ea0-a323-da0047a3d741 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:55:59.839861 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525c25-c1f8-4ea0-a323-da0047a3d741 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:55:59.844294 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc4bb7-b084-4ec7-811b-d6b48d63e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:55:59.844969 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc4bb7-b084-4ec7-811b-d6b48d63e10c admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:55:59.845253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc4bb7-b084-4ec7-811b-d6b48d63e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:55:59.845529 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc4bb7-b084-4ec7-811b-d6b48d63e10c admin admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:55:59.846258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc4bb7-b084-4ec7-811b-d6b48d63e10c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:55:59.848043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-abdc4bb7-b084-4ec7-811b-d6b48d63e10c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:55:59.848043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 18:55:59.848043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 18:55:59.849215 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc4bb7-b084-4ec7-811b-d6b48d63e10c admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:55:59.867105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 552/1095] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Jul 14 18:55:59 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:56:02.122797 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f63273-67ea-45a7-afab-0312cf2e7954 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:02.123358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f63273-67ea-45a7-afab-0312cf2e7954 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:02.123358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f63273-67ea-45a7-afab-0312cf2e7954 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:02.124759 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 544/1096] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:56:02.129943 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbe2e0-cfc5-4b0a-9b6d-50cc69417a29 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:02.130370 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbe2e0-cfc5-4b0a-9b6d-50cc69417a29 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:02.130509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbe2e0-cfc5-4b0a-9b6d-50cc69417a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:02.148025 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-cadbe2e0-cfc5-4b0a-9b6d-50cc69417a29 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:56:02.149258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-cadbe2e0-cfc5-4b0a-9b6d-50cc69417a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:56:02.157463 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 553/1097] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:56:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:56:02.201550 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f63273-67ea-45a7-afab-0312cf2e7954 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:56:02.215800 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f63273-67ea-45a7-afab-0312cf2e7954 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:56:02.220674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738e934-a65f-4064-96ae-3cfdbb4b1916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:56:02.221310 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738e934-a65f-4064-96ae-3cfdbb4b1916 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:02.221596 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738e934-a65f-4064-96ae-3cfdbb4b1916 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:02.221876 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738e934-a65f-4064-96ae-3cfdbb4b1916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:02.231041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738e934-a65f-4064-96ae-3cfdbb4b1916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:56:02.232661 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738e934-a65f-4064-96ae-3cfdbb4b1916 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:56:02.242059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 545/1098] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:56:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:56:04.660574 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2917d6-ca5f-4a1e-8aa7-d1b122d5e871 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:04.661115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2917d6-ca5f-4a1e-8aa7-d1b122d5e871 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:04.661115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2917d6-ca5f-4a1e-8aa7-d1b122d5e871 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:04.662404 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 554/1099] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:56:04.667625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05426b-3ad8-41a3-9b7c-91fc026dbadd None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:04.668047 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05426b-3ad8-41a3-9b7c-91fc026dbadd None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:04.668160 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05426b-3ad8-41a3-9b7c-91fc026dbadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:04.685536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-2c05426b-3ad8-41a3-9b7c-91fc026dbadd None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:56:04.686720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-2c05426b-3ad8-41a3-9b7c-91fc026dbadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:56:04.694320 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 546/1100] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:56:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:56:04.731282 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2917d6-ca5f-4a1e-8aa7-d1b122d5e871 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:56:04.741888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2917d6-ca5f-4a1e-8aa7-d1b122d5e871 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:56:04.745348 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad3f3f-e4c5-4b24-97ca-201f26115849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:56:04.745978 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad3f3f-e4c5-4b24-97ca-201f26115849 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:04.746266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad3f3f-e4c5-4b24-97ca-201f26115849 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:04.746544 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad3f3f-e4c5-4b24-97ca-201f26115849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:04.755278 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad3f3f-e4c5-4b24-97ca-201f26115849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:56:04.756768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad3f3f-e4c5-4b24-97ca-201f26115849 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:56:04.766480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 555/1101] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:56:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:56:07.043533 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5f07-2751-426d-83d3-189ae3eca223 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:07.044071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5f07-2751-426d-83d3-189ae3eca223 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:07.044071 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5f07-2751-426d-83d3-189ae3eca223 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:07.045398 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 547/1102] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:56:07.051122 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a96a5-c7ee-477d-bee8-98e0eb501bfa None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:07.051523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a96a5-c7ee-477d-bee8-98e0eb501bfa None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:07.051693 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a96a5-c7ee-477d-bee8-98e0eb501bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:07.070213 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-4a7a96a5-c7ee-477d-bee8-98e0eb501bfa None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:56:07.071412 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-4a7a96a5-c7ee-477d-bee8-98e0eb501bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:56:07.079740 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 556/1103] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:56:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:56:07.118743 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da5f07-2751-426d-83d3-189ae3eca223 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:56:07.129259 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da5f07-2751-426d-83d3-189ae3eca223 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:56:07.132701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47761d6c-1d39-4355-a847-122bb13da2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:56:07.133330 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761d6c-1d39-4355-a847-122bb13da2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:07.133620 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761d6c-1d39-4355-a847-122bb13da2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:07.133897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761d6c-1d39-4355-a847-122bb13da2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:07.143271 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47761d6c-1d39-4355-a847-122bb13da2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:56:07.144737 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47761d6c-1d39-4355-a847-122bb13da2d3 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:56:07.154594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 548/1104] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:56:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:56:09.440063 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06e01-590f-45e0-89da-a189c49dbe2e None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:09.440649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06e01-590f-45e0-89da-a189c49dbe2e None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:09.440649 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06e01-590f-45e0-89da-a189c49dbe2e None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:09.442026 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 557/1105] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:56:09.447094 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2d49-a329-4e6c-9827-dab894a252bf None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:09.447523 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2d49-a329-4e6c-9827-dab894a252bf None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:09.447641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2d49-a329-4e6c-9827-dab894a252bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:09.465507 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-fbbe2d49-a329-4e6c-9827-dab894a252bf None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:56:09.466680 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-fbbe2d49-a329-4e6c-9827-dab894a252bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:56:09.474170 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 549/1106] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:56:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:56:09.515105 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06e01-590f-45e0-89da-a189c49dbe2e None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:56:09.525526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06e01-590f-45e0-89da-a189c49dbe2e None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:56:09.529452 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347a70-c640-4a85-86a8-f6ad8aa92814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:56:09.530076 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347a70-c640-4a85-86a8-f6ad8aa92814 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:09.530359 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347a70-c640-4a85-86a8-f6ad8aa92814 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:09.530635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347a70-c640-4a85-86a8-f6ad8aa92814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:09.539265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347a70-c640-4a85-86a8-f6ad8aa92814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:56:09.540707 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347a70-c640-4a85-86a8-f6ad8aa92814 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:56:09.550638 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 558/1107] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:56:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:56:11.940547 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57a9f-f690-4d76-b539-62fbb0b364c7 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:11.941131 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57a9f-f690-4d76-b539-62fbb0b364c7 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:11.941131 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d57a9f-f690-4d76-b539-62fbb0b364c7 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:11.942428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 550/1108] 10.222.0.72 () {54 vars in 926 bytes} [Thu Jul 14 18:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:56:11.947557 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa4467-b6ab-4086-ad52-ea647106c145 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:11.947956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa4467-b6ab-4086-ad52-ea647106c145 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:11.948120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa4467-b6ab-4086-ad52-ea647106c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:11.966263 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-35aa4467-b6ab-4086-ad52-ea647106c145 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:56:11.967468 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-35aa4467-b6ab-4086-ad52-ea647106c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:56:11.975384 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 559/1109] 10.222.0.72 () {58 vars in 1023 bytes} [Thu Jul 14 18:56:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:56:12.016825 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d57a9f-f690-4d76-b539-62fbb0b364c7 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:56:12.027298 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d57a9f-f690-4d76-b539-62fbb0b364c7 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:56:12.030662 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdae81-ef12-4e11-aba2-34288db61a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:56:12.031289 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdae81-ef12-4e11-aba2-34288db61a65 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:56:12.031564 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdae81-ef12-4e11-aba2-34288db61a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:56:12.031834 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdae81-ef12-4e11-aba2-34288db61a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:56:12.040505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdae81-ef12-4e11-aba2-34288db61a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:56:12.041914 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdae81-ef12-4e11-aba2-34288db61a65 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:56:12.051291 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 551/1110] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:56:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:56:21.961013 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=33 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:56:22.047303 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=33 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:57:51.263136 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46061f9c-2b68-44ed-a987-e167561e21e3 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.263755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46061f9c-2b68-44ed-a987-e167561e21e3 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.263755 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46061f9c-2b68-44ed-a987-e167561e21e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.282527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-46061f9c-2b68-44ed-a987-e167561e21e3 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:57:51.283746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-46061f9c-2b68-44ed-a987-e167561e21e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:57:51.291563 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 560/1111] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 18:57:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:57:51.300607 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10682-b057-4d75-8406-cc4e1f66d3ff None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.301095 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10682-b057-4d75-8406-cc4e1f66d3ff None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.301200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c10682-b057-4d75-8406-cc4e1f66d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.318431 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-e1c10682-b057-4d75-8406-cc4e1f66d3ff None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:57:51.319612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-e1c10682-b057-4d75-8406-cc4e1f66d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:57:51.327808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 552/1112] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 18:57:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:57:51.332109 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46061f9c-2b68-44ed-a987-e167561e21e3 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.342330 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46061f9c-2b68-44ed-a987-e167561e21e3 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.346891 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.347541 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.347831 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.348111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.348871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:57:51.349185 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.350197 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:51.350197 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 18:57:51.350197 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 18:57:51.351086 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:51.362511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 561/1113] 10.222.0.72 () {58 vars in 1152 bytes} [Thu Jul 14 18:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:57:51.371392 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c10682-b057-4d75-8406-cc4e1f66d3ff None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.380534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c10682-b057-4d75-8406-cc4e1f66d3ff None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.385007 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.385651 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.385929 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.386198 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.387488 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.389232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING py.warnings [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:51.389232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: warnings.warn(msg) Jul 14 18:57:51.389232 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: Jul 14 18:57:51.390409 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:51.415122 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 553/1114] 10.222.0.72 () {60 vars in 1152 bytes} [Thu Jul 14 18:57:51 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:57:51.419020 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.429126 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111f696-ea50-4e05-83c7-796432270f5b admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.485313 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.485979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.486266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.486543 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.487241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.488279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:51.488279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 18:57:51.488279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 18:57:51.489476 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:51.509423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 562/1115] 10.222.0.72 () {60 vars in 1143 bytes} [Thu Jul 14 18:57:51 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:57:51.513685 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.523748 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94022c-6380-4287-a062-24359dcd2efe admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.528379 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.529040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.529328 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.529606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.530541 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.531645 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING py.warnings [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:51.531645 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: warnings.warn(msg) Jul 14 18:57:51.531645 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: Jul 14 18:57:51.532831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:51.547164 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 554/1116] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:57:51.551231 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.561986 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc21f6-12ea-48cd-bcf6-bbb42259bb04 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.566696 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182680-2eca-4d5b-b8e7-8022e9827bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.567345 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182680-2eca-4d5b-b8e7-8022e9827bbb admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.567633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182680-2eca-4d5b-b8e7-8022e9827bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.567913 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182680-2eca-4d5b-b8e7-8022e9827bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.568700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182680-2eca-4d5b-b8e7-8022e9827bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.569716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-aa182680-2eca-4d5b-b8e7-8022e9827bbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:51.569716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 18:57:51.569716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 18:57:51.570599 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182680-2eca-4d5b-b8e7-8022e9827bbb admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:51.583786 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 563/1117] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:57:51.587764 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.597832 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1994be1-715a-4e8c-ad64-d60f285f4a61 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.602542 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a17c0-dfda-40b8-a730-2a9b84964930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.603418 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a17c0-dfda-40b8-a730-2a9b84964930 admin admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.603699 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a17c0-dfda-40b8-a730-2a9b84964930 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.603972 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a17c0-dfda-40b8-a730-2a9b84964930 admin admin] PATH_INFO: `/v3/projects/e6525c1ad2f84261afa9955dca0e1058/users/f219d200f5b640379e2d70bc9c7b42ff/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.618812 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a17c0-dfda-40b8-a730-2a9b84964930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6525c1ad2f84261afa9955dca0e1058, user_id=f219d200f5b640379e2d70bc9c7b42ff, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.619837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING py.warnings [None req-785a17c0-dfda-40b8-a730-2a9b84964930 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:51.619837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: warnings.warn(msg) Jul 14 18:57:51.619837 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: Jul 14 18:57:51.621901 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a17c0-dfda-40b8-a730-2a9b84964930 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:51.634471 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 555/1118] 10.222.0.72 () {60 vars in 1482 bytes} [Thu Jul 14 18:57:51 2022] PUT /identity/v3/projects/e6525c1ad2f84261afa9955dca0e1058/users/f219d200f5b640379e2d70bc9c7b42ff/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:57:51.646827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c884d-ea4c-451c-87f7-49687d7b4ad7 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.647120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c884d-ea4c-451c-87f7-49687d7b4ad7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.647402 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c884d-ea4c-451c-87f7-49687d7b4ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.674107 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-0f3c884d-ea4c-451c-87f7-49687d7b4ad7 None None] MFA Rules not processed for user `f219d200f5b640379e2d70bc9c7b42ff`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:57:51.675310 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-0f3c884d-ea4c-451c-87f7-49687d7b4ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:57:51.738592 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 564/1119] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 18:57:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:57:51.752131 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23eee-1ac0-49d8-892a-001cd6945242 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.752455 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23eee-1ac0-49d8-892a-001cd6945242 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.752733 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23eee-1ac0-49d8-892a-001cd6945242 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.754075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 556/1120] 10.222.0.72 () {54 vars in 963 bytes} [Thu Jul 14 18:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:57:51.758770 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6778b7-c63f-472a-832c-b62754da5e01 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.759065 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6778b7-c63f-472a-832c-b62754da5e01 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.759352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6778b7-c63f-472a-832c-b62754da5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.777165 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-0d6778b7-c63f-472a-832c-b62754da5e01 None None] MFA Rules not processed for user `de739f19f30b4f0ba2c90c96429537d8`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:57:51.778291 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-0d6778b7-c63f-472a-832c-b62754da5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:57:51.821901 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:57:51.830360 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 565/1121] 10.222.0.72 () {58 vars in 1060 bytes} [Thu Jul 14 18:57:51 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:57:51.837632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac23eee-1ac0-49d8-892a-001cd6945242 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.848447 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac23eee-1ac0-49d8-892a-001cd6945242 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.851893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de739f19f30b4f0ba2c90c96429537d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.852556 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.852842 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.853120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.861744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.863159 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:51.871856 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 557/1122] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:57:51 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:57:51.907516 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e6d2-d305-4084-b644-e7e7bf4923c8 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.907818 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e6d2-d305-4084-b644-e7e7bf4923c8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.908115 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e6d2-d305-4084-b644-e7e7bf4923c8 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.909446 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 566/1123] 10.222.0.72 () {52 vars in 829 bytes} [Thu Jul 14 18:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:57:51.912963 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:51.973802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36002f83-9f10-4ac1-992f-eca1d0a4810b service cinder] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:51.978323 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:51.979189 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:51.979472 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:51.979754 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] PATH_INFO: `/v3/users/f219d200f5b640379e2d70bc9c7b42ff` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:51.980951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f219d200f5b640379e2d70bc9c7b42ff)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:51.982045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING py.warnings [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:51.982045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: warnings.warn(msg) Jul 14 18:57:51.982045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: Jul 14 18:57:51.983231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:52.049252 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f219d200f5b640379e2d70bc9c7b42ff'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.049825 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f219d200f5b640379e2d70bc9c7b42ff'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.059168 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f219d200f5b640379e2d70bc9c7b42ff'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.070945 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f219d200f5b640379e2d70bc9c7b42ff'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.071720 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f219d200f5b640379e2d70bc9c7b42ff'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.095650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 558/1124] 10.222.0.72 () {58 vars in 1223 bytes} [Thu Jul 14 18:57:51 2022] DELETE /identity/v3/users/f219d200f5b640379e2d70bc9c7b42ff => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:57:52.099964 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:52.100273 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:52.100552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:52.117403 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:57:52.118579 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:57:52.175811 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 567/1125] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 18:57:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:57:52.185695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:52.187076 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:57:52.192434 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:57:52.245258 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918a8dc-de7b-4c6b-b660-f1f2bd1f5166 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:52.249424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5017673-c6a9-4692-8f46-be0f83b86e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:52.250054 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5017673-c6a9-4692-8f46-be0f83b86e8a service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:52.250333 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5017673-c6a9-4692-8f46-be0f83b86e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:52.250604 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5017673-c6a9-4692-8f46-be0f83b86e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:52.259286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5017673-c6a9-4692-8f46-be0f83b86e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:52.260771 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5017673-c6a9-4692-8f46-be0f83b86e8a service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:52.270160 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 559/1126] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:57:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:57:52.624168 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:57:52.625622 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:57:52.637700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da6d1-fcde-42bf-91d8-c0a34af5fa82 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:57:52.643509 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:57:52.644526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:57:52.644818 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:57:52.645094 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] PATH_INFO: `/v3/projects/e6525c1ad2f84261afa9955dca0e1058` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:57:52.646296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6525c1ad2f84261afa9955dca0e1058)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:57:52.647333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 18:57:52.647333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 18:57:52.647333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 18:57:52.648527 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:57:52.710754 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6525c1ad2f84261afa9955dca0e1058', 'request_id': 'req-dd2d152d-7545-464a-9094-2963b09d07c4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.717424 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6525c1ad2f84261afa9955dca0e1058', 'request_id': 'req-dd2d152d-7545-464a-9094-2963b09d07c4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.730816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6525c1ad2f84261afa9955dca0e1058', 'request_id': 'req-dd2d152d-7545-464a-9094-2963b09d07c4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.744648 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] The token cache is being invalidate because project e6525c1ad2f84261afa9955dca0e1058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=120840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:57:52.744938 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.745586 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-dd2d152d-7545-464a-9094-2963b09d07c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:57:52.747187 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 568/1127] 10.222.0.72 () {58 vars in 1232 bytes} [Thu Jul 14 18:57:52 2022] DELETE /identity/v3/projects/e6525c1ad2f84261afa9955dca0e1058 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:58:02.266041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=25 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:58:02.741912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:59:19.910878 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e73524-1c52-4d1c-bd6d-6c6c2177da1a None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:19.911483 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e73524-1c52-4d1c-bd6d-6c6c2177da1a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:19.911483 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e73524-1c52-4d1c-bd6d-6c6c2177da1a None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:19.912816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 560/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:19.917586 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17b060-82a4-475f-928d-c67f3f9234bc None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:19.917999 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17b060-82a4-475f-928d-c67f3f9234bc None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:19.918150 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17b060-82a4-475f-928d-c67f3f9234bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:19.988847 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-4a17b060-82a4-475f-928d-c67f3f9234bc None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:19.990043 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-4a17b060-82a4-475f-928d-c67f3f9234bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:20.083585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 569/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:59:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:20.252802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e73524-1c52-4d1c-bd6d-6c6c2177da1a None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:20.254485 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-15e73524-1c52-4d1c-bd6d-6c6c2177da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:20.348448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e73524-1c52-4d1c-bd6d-6c6c2177da1a None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:20.353329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35869-f6b2-4d79-beaf-18fa220eb8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:20.353971 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35869-f6b2-4d79-beaf-18fa220eb8f1 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:20.354258 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35869-f6b2-4d79-beaf-18fa220eb8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:20.354536 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35869-f6b2-4d79-beaf-18fa220eb8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:20.362736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d35869-f6b2-4d79-beaf-18fa220eb8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:20.364354 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d35869-f6b2-4d79-beaf-18fa220eb8f1 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:20.374124 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 561/1130] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:59:21.198629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b729-f227-4f80-bda0-50708bf884d1 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:21.199175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b729-f227-4f80-bda0-50708bf884d1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:21.199175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b729-f227-4f80-bda0-50708bf884d1 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:21.200603 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 570/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:21.205421 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3b30-9d51-4176-880e-247034817b3d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:21.205852 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3b30-9d51-4176-880e-247034817b3d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:21.205986 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3b30-9d51-4176-880e-247034817b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:21.224278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-a7aa3b30-9d51-4176-880e-247034817b3d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:21.225494 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-a7aa3b30-9d51-4176-880e-247034817b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:21.233937 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 562/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:59:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:21.391604 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b729-f227-4f80-bda0-50708bf884d1 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:21.405339 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b729-f227-4f80-bda0-50708bf884d1 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:21.410179 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81256-bf95-4e96-9c08-cabe53dfbcb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:21.410803 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81256-bf95-4e96-9c08-cabe53dfbcb0 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:21.411092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81256-bf95-4e96-9c08-cabe53dfbcb0 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:21.411367 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81256-bf95-4e96-9c08-cabe53dfbcb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:21.419204 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81256-bf95-4e96-9c08-cabe53dfbcb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:21.421108 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81256-bf95-4e96-9c08-cabe53dfbcb0 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:21.430290 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 571/1133] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:59:26.700953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9207b7-dc0c-499e-9d23-bb77d7e453b4 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:26.701505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9207b7-dc0c-499e-9d23-bb77d7e453b4 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:26.701613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9207b7-dc0c-499e-9d23-bb77d7e453b4 None None] PATH_INFO: `/v3` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:26.702838 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 563/1134] 10.222.0.79 () {54 vars in 925 bytes} [Thu Jul 14 18:59:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:59:26.708892 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1ad0-0510-4b86-a1be-b9bc09c963f8 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:26.709310 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1ad0-0510-4b86-a1be-b9bc09c963f8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:26.709481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1ad0-0510-4b86-a1be-b9bc09c963f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:26.737431 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-397b1ad0-0510-4b86-a1be-b9bc09c963f8 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:26.738636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-397b1ad0-0510-4b86-a1be-b9bc09c963f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:26.792386 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:59:26.802279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 572/1135] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Jul 14 18:59:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:31.219490 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=42 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:59:32.663201 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0687d0-c740-4ab9-8230-0223cb595672 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:32.663811 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0687d0-c740-4ab9-8230-0223cb595672 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:32.663811 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0687d0-c740-4ab9-8230-0223cb595672 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:32.665089 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 564/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:32.670061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796adae-ade6-4458-9ff8-c8559d0299cd None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:32.670746 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796adae-ade6-4458-9ff8-c8559d0299cd None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:32.670856 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796adae-ade6-4458-9ff8-c8559d0299cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:32.688884 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-1796adae-ade6-4458-9ff8-c8559d0299cd None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:32.690072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-1796adae-ade6-4458-9ff8-c8559d0299cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:32.698091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 573/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:59:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:32.857118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0687d0-c740-4ab9-8230-0223cb595672 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:32.870467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0687d0-c740-4ab9-8230-0223cb595672 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:32.875628 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857fdf7-8054-4f72-a73a-29c988729697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:32.876300 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857fdf7-8054-4f72-a73a-29c988729697 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:32.876587 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857fdf7-8054-4f72-a73a-29c988729697 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:32.876864 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857fdf7-8054-4f72-a73a-29c988729697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:32.884900 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857fdf7-8054-4f72-a73a-29c988729697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:32.886475 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857fdf7-8054-4f72-a73a-29c988729697 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:32.896297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 565/1138] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:59:33.713191 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d983cd-99a6-4927-b560-a16d956452d7 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:33.713737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d983cd-99a6-4927-b560-a16d956452d7 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:33.713737 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d983cd-99a6-4927-b560-a16d956452d7 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:33.715167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 574/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:33.720674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3fc9-5cb1-40c7-b946-9d17eb164b17 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:33.721104 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3fc9-5cb1-40c7-b946-9d17eb164b17 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:33.721239 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3fc9-5cb1-40c7-b946-9d17eb164b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:33.739529 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-abbc3fc9-5cb1-40c7-b946-9d17eb164b17 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:33.740752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-abbc3fc9-5cb1-40c7-b946-9d17eb164b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:33.748522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 566/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:59:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:33.906448 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d983cd-99a6-4927-b560-a16d956452d7 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:33.920350 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d983cd-99a6-4927-b560-a16d956452d7 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:33.925570 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bc4b2-c0bc-4e93-97a8-3e614e6d04b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:33.926203 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc4b2-c0bc-4e93-97a8-3e614e6d04b2 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:33.926490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc4b2-c0bc-4e93-97a8-3e614e6d04b2 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:33.926769 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc4b2-c0bc-4e93-97a8-3e614e6d04b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:33.934756 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bc4b2-c0bc-4e93-97a8-3e614e6d04b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:33.936373 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bc4b2-c0bc-4e93-97a8-3e614e6d04b2 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:33.945682 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 575/1141] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:59:36.636342 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389de3-7c58-4370-838c-58dff42b91be None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:36.636933 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389de3-7c58-4370-838c-58dff42b91be None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:36.636933 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d389de3-7c58-4370-838c-58dff42b91be None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:36.638778 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 567/1142] 10.222.0.72 () {54 vars in 960 bytes} [Thu Jul 14 18:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:36.643635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337caa-5537-4c41-a113-1b96ddb29d77 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:36.644089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337caa-5537-4c41-a113-1b96ddb29d77 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:36.644226 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337caa-5537-4c41-a113-1b96ddb29d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:36.662408 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-f6337caa-5537-4c41-a113-1b96ddb29d77 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:36.663594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-f6337caa-5537-4c41-a113-1b96ddb29d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:36.672300 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 576/1143] 10.222.0.72 () {58 vars in 1057 bytes} [Thu Jul 14 18:59:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:36.679632 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d389de3-7c58-4370-838c-58dff42b91be None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:36.692496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d389de3-7c58-4370-838c-58dff42b91be None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:36.697237 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fe105-a400-4718-a3ad-09b2489b605f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:36.697859 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe105-a400-4718-a3ad-09b2489b605f service placement] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:36.698139 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe105-a400-4718-a3ad-09b2489b605f service placement] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:36.698412 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe105-a400-4718-a3ad-09b2489b605f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:36.707074 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fe105-a400-4718-a3ad-09b2489b605f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:36.708670 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fe105-a400-4718-a3ad-09b2489b605f service placement] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:36.719219 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 568/1144] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:36 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:59:45.157806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4193fef-cff6-4cc2-8605-3e9904cf9814 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:45.158380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4193fef-cff6-4cc2-8605-3e9904cf9814 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:45.158380 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4193fef-cff6-4cc2-8605-3e9904cf9814 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:45.159720 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 577/1145] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:45.164596 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32d8e-7e55-4190-b801-96fd2a42c05d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:45.165005 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32d8e-7e55-4190-b801-96fd2a42c05d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:45.165161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32d8e-7e55-4190-b801-96fd2a42c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:45.182962 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-49f32d8e-7e55-4190-b801-96fd2a42c05d None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:45.184683 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-49f32d8e-7e55-4190-b801-96fd2a42c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:45.192342 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 569/1146] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:59:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:45.350576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4193fef-cff6-4cc2-8605-3e9904cf9814 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:45.364462 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4193fef-cff6-4cc2-8605-3e9904cf9814 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:45.369335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7794-b520-496e-9257-b8fc49b2a967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:45.369975 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7794-b520-496e-9257-b8fc49b2a967 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:45.370265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7794-b520-496e-9257-b8fc49b2a967 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:45.370549 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7794-b520-496e-9257-b8fc49b2a967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:45.379451 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e7794-b520-496e-9257-b8fc49b2a967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:45.381084 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e7794-b520-496e-9257-b8fc49b2a967 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:45.390474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 578/1147] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:59:46.218109 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d6fee-2970-4c02-bb15-4e50af3a3eeb None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:46.218667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d6fee-2970-4c02-bb15-4e50af3a3eeb None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:46.218667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d6fee-2970-4c02-bb15-4e50af3a3eeb None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:46.220017 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 570/1148] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 18:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:46.224703 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e126e-1eac-4b65-aaaf-d7b054363f29 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:46.225146 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e126e-1eac-4b65-aaaf-d7b054363f29 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:46.225273 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e126e-1eac-4b65-aaaf-d7b054363f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:46.242877 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-a66e126e-1eac-4b65-aaaf-d7b054363f29 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:46.244072 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-a66e126e-1eac-4b65-aaaf-d7b054363f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:46.251886 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 579/1149] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 18:59:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:46.407515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d6fee-2970-4c02-bb15-4e50af3a3eeb None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:46.422307 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d6fee-2970-4c02-bb15-4e50af3a3eeb None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:46.427274 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8f31-74be-477b-87d2-4ed04e38026f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:46.427907 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8f31-74be-477b-87d2-4ed04e38026f service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:46.428191 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8f31-74be-477b-87d2-4ed04e38026f service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:46.428495 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8f31-74be-477b-87d2-4ed04e38026f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:46.436614 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8f31-74be-477b-87d2-4ed04e38026f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:46.438179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8f31-74be-477b-87d2-4ed04e38026f service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:46.447701 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 571/1150] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:59:50.686085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9524e-5f58-477f-bb38-7e14d4842890 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:50.686629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9524e-5f58-477f-bb38-7e14d4842890 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:50.686629 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9524e-5f58-477f-bb38-7e14d4842890 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:50.688002 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 580/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:50.693299 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac80c4-e8ed-4dc7-ac89-33fc4af5f9aa None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:50.693732 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac80c4-e8ed-4dc7-ac89-33fc4af5f9aa None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:50.693863 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac80c4-e8ed-4dc7-ac89-33fc4af5f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:50.711579 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-0aac80c4-e8ed-4dc7-ac89-33fc4af5f9aa None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:50.712801 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-0aac80c4-e8ed-4dc7-ac89-33fc4af5f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:50.720461 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 572/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:59:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:59:50.758687 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9524e-5f58-477f-bb38-7e14d4842890 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:50.760422 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-f1f9524e-5f58-477f-bb38-7e14d4842890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:50.816797 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9524e-5f58-477f-bb38-7e14d4842890 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:50.820236 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc078224-42b9-4b5f-bb0c-d8c748eec4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:50.820871 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078224-42b9-4b5f-bb0c-d8c748eec4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:50.821152 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078224-42b9-4b5f-bb0c-d8c748eec4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:50.821427 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078224-42b9-4b5f-bb0c-d8c748eec4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:50.830384 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc078224-42b9-4b5f-bb0c-d8c748eec4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:50.832320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc078224-42b9-4b5f-bb0c-d8c748eec4a5 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:50.841671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 581/1153] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:59:53.031752 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a6136-5048-487b-a9c7-e18b95e8c00f None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:53.032361 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a6136-5048-487b-a9c7-e18b95e8c00f None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:53.032361 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a6136-5048-487b-a9c7-e18b95e8c00f None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:53.033683 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 573/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:53.038721 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a541e-7f5f-4bec-9961-8bd6579b5d64 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:53.039156 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a541e-7f5f-4bec-9961-8bd6579b5d64 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:53.039292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a541e-7f5f-4bec-9961-8bd6579b5d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:53.057523 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-279a541e-7f5f-4bec-9961-8bd6579b5d64 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:53.058745 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-279a541e-7f5f-4bec-9961-8bd6579b5d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:53.066544 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 582/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:59:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:59:53.103217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a6136-5048-487b-a9c7-e18b95e8c00f None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:53.113951 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a6136-5048-487b-a9c7-e18b95e8c00f None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:53.117465 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c8a2-9791-4823-bc3c-d5bbc1b952a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:53.118106 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c8a2-9791-4823-bc3c-d5bbc1b952a3 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:53.118391 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c8a2-9791-4823-bc3c-d5bbc1b952a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:53.118699 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c8a2-9791-4823-bc3c-d5bbc1b952a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:53.127601 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077c8a2-9791-4823-bc3c-d5bbc1b952a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:53.129076 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077c8a2-9791-4823-bc3c-d5bbc1b952a3 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:53.138861 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 574/1156] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:59:56.998486 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efca76-4bed-4cd0-89a3-6e0dae971a9d None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:56.999046 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efca76-4bed-4cd0-89a3-6e0dae971a9d None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:56.999046 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efca76-4bed-4cd0-89a3-6e0dae971a9d None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:57.000449 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 583/1157] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:57.005615 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7ae2-d4d4-4fcd-a6ce-81a9ab5372d4 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:57.006046 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7ae2-d4d4-4fcd-a6ce-81a9ab5372d4 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:57.006209 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7ae2-d4d4-4fcd-a6ce-81a9ab5372d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:57.023969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-eceb7ae2-d4d4-4fcd-a6ce-81a9ab5372d4 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:57.025459 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-eceb7ae2-d4d4-4fcd-a6ce-81a9ab5372d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:57.033773 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 575/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:59:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:59:57.305598 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efca76-4bed-4cd0-89a3-6e0dae971a9d None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:57.307296 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-26efca76-4bed-4cd0-89a3-6e0dae971a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:57.313159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=51 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:59:57.364957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efca76-4bed-4cd0-89a3-6e0dae971a9d None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:57.368487 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a988d4-99e1-4dd8-80f1-8cb33e8aaada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de739f19f30b4f0ba2c90c96429537d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:57.369131 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a988d4-99e1-4dd8-80f1-8cb33e8aaada service cinder] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:57.369421 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a988d4-99e1-4dd8-80f1-8cb33e8aaada service cinder] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:57.369716 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a988d4-99e1-4dd8-80f1-8cb33e8aaada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:57.378498 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a988d4-99e1-4dd8-80f1-8cb33e8aaada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:57.379975 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a988d4-99e1-4dd8-80f1-8cb33e8aaada service cinder] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:57.389799 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 584/1159] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:59:59.635715 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a649-5c49-4c33-a435-3e31a6a42dc2 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:59.636277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a649-5c49-4c33-a435-3e31a6a42dc2 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:59.636277 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a649-5c49-4c33-a435-3e31a6a42dc2 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:59.637625 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 576/1160] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 18:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:59:59.642707 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27c2a-ec99-4d17-a38e-ae65f33cdec1 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:59.643133 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27c2a-ec99-4d17-a38e-ae65f33cdec1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:59.643275 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27c2a-ec99-4d17-a38e-ae65f33cdec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:59.660960 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-83f27c2a-ec99-4d17-a38e-ae65f33cdec1 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:59:59.662148 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-83f27c2a-ec99-4d17-a38e-ae65f33cdec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:59.670661 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 585/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 18:59:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:59:59.947036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a649-5c49-4c33-a435-3e31a6a42dc2 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:59:59.948768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-0ef9a649-5c49-4c33-a435-3e31a6a42dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:59:59.961690 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a649-5c49-4c33-a435-3e31a6a42dc2 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:59:59.965708 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784f92-72f5-4e14-9d53-bf621c5f1351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de739f19f30b4f0ba2c90c96429537d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:59:59.966322 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784f92-72f5-4e14-9d53-bf621c5f1351 service cinder] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:59:59.966610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784f92-72f5-4e14-9d53-bf621c5f1351 service cinder] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:59:59.966887 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784f92-72f5-4e14-9d53-bf621c5f1351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:59:59.975653 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784f92-72f5-4e14-9d53-bf621c5f1351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:59:59.977122 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784f92-72f5-4e14-9d53-bf621c5f1351 service cinder] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:59:59.986960 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 577/1162] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 18:59:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:00:09.655845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=28 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:09.982870 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=42 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:21.042253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd730e5c-0585-4cb0-8ab6-dfbb30751663 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.042917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd730e5c-0585-4cb0-8ab6-dfbb30751663 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.042917 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd730e5c-0585-4cb0-8ab6-dfbb30751663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.048761 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41478-ae1e-4316-85ee-b4904d3f675b None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.049213 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41478-ae1e-4316-85ee-b4904d3f675b None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.049319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b41478-ae1e-4316-85ee-b4904d3f675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.061853 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-fd730e5c-0585-4cb0-8ab6-dfbb30751663 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:21.063061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-fd730e5c-0585-4cb0-8ab6-dfbb30751663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:21.067331 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-d9b41478-ae1e-4316-85ee-b4904d3f675b None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:21.068534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-d9b41478-ae1e-4316-85ee-b4904d3f675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:21.072230 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 586/1163] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:21.076888 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 578/1164] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:21.079642 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fc981-b5d1-4060-bb8b-a8dbab0060bd None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.079935 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fc981-b5d1-4060-bb8b-a8dbab0060bd None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.080240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fc981-b5d1-4060-bb8b-a8dbab0060bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.084650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34114fe-6360-4fbf-9d78-b37a2f68df43 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.084936 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34114fe-6360-4fbf-9d78-b37a2f68df43 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.085214 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34114fe-6360-4fbf-9d78-b37a2f68df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.098900 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-102fc981-b5d1-4060-bb8b-a8dbab0060bd None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:21.100095 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-102fc981-b5d1-4060-bb8b-a8dbab0060bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:21.102659 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-d34114fe-6360-4fbf-9d78-b37a2f68df43 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:21.103805 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-d34114fe-6360-4fbf-9d78-b37a2f68df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:21.108183 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 587/1165] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:21.111417 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 579/1166] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:21.113394 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fc981-b5d1-4060-bb8b-a8dbab0060bd None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.115691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34114fe-6360-4fbf-9d78-b37a2f68df43 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.123385 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fc981-b5d1-4060-bb8b-a8dbab0060bd None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.125404 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34114fe-6360-4fbf-9d78-b37a2f68df43 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.127976 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.128645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.128932 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.129209 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] PATH_INFO: `/v3/domains` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.129924 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=120840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 19:01:21.130032 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.130258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.130585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.130873 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.131154 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] PATH_INFO: `/v3/domains` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.131813 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.131935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=120841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 19:01:21.132171 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.133814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING py.warnings [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:01:21.133814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: warnings.warn(msg) Jul 14 19:01:21.133814 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: Jul 14 19:01:21.135039 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.144009 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 588/1167] 10.222.0.72 () {58 vars in 1152 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 19:01:21.150649 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 580/1168] 10.222.0.72 () {58 vars in 1152 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 19:01:21.151939 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.158233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.161749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee268ae-76d7-4c06-9b2a-5053e5029095 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.167084 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.167731 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.167935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076085d-5b80-4c50-a6c9-349e5f91179a admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.168047 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.168310 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] PATH_INFO: `/v3/projects` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.169011 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.170284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:01:21.170284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 19:01:21.170284 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 19:01:21.171474 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.172844 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.173470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.173755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.174034 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.174744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.176652 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.208757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 589/1169] 10.222.0.72 () {60 vars in 1152 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 19:01:21.215874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 581/1170] 10.222.0.72 () {60 vars in 1152 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 19:01:21.216039 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.217243 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.279506 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8072f-5151-4404-88fa-391c7b71f965 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.284227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.284983 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.285271 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.285552 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.286064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ab27-2b7e-4d49-937a-6ecf39db6e7c admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.286245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.288227 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.290864 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.291529 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.291817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.292093 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.292860 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.293816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING py.warnings [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:01:21.293816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: warnings.warn(msg) Jul 14 19:01:21.293816 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: Jul 14 19:01:21.295320 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.309908 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 590/1171] 10.222.0.72 () {60 vars in 1143 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 19:01:21.314085 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.316393 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 582/1172] 10.222.0.72 () {60 vars in 1143 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 19:01:21.320312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.324884 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7ee02-4976-455d-acc0-e92a7809b44d admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.329429 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.330076 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.330359 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.330639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.330803 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd324cba-22d5-48d8-8538-024dac5ae11d admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.331352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.333007 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.335913 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.336646 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.336930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.337329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.338082 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.339677 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.343210 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 591/1173] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 19:01:21.346957 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.353182 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 583/1174] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 19:01:21.356986 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.358078 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42a078-62eb-4acb-97b9-9c407c919ed9 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.362665 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.363318 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.363607 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.363890 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.364645 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.366234 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.366953 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171025e-bf05-47d2-80b3-f9a2fe6ca90d admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.372157 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.372831 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.373118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.373405 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.374120 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.375696 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.377385 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 592/1175] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 19:01:21.381175 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.392463 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 584/1176] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 19:01:21.392636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2f4d8-35ae-4975-b9e7-536d185dbf92 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.393800 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.396112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece85abf-0464-4d93-b5ef-96938ac8c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.397031 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece85abf-0464-4d93-b5ef-96938ac8c46d admin admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.397322 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece85abf-0464-4d93-b5ef-96938ac8c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.397614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece85abf-0464-4d93-b5ef-96938ac8c46d admin admin] PATH_INFO: `/v3/projects/0d466c96198746409cfc1ed86339cc7e/users/57b8a1f3d0064b199c0a994aa92958a7/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.403724 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d33d9-32e0-4885-b963-a8c628f4a7d6 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.408441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c727b-e8d9-49bf-b39b-29c15725ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.409333 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c727b-e8d9-49bf-b39b-29c15725ff54 admin admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.409623 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c727b-e8d9-49bf-b39b-29c15725ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.409958 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c727b-e8d9-49bf-b39b-29c15725ff54 admin admin] PATH_INFO: `/v3/projects/d154d489c3b7403cac96ff091b186ee4/users/da7b33ab0e854680bfcde4348b65b6ee/roles/ae946283d08e403cba50982b7ee3d73a` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.413206 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece85abf-0464-4d93-b5ef-96938ac8c46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d466c96198746409cfc1ed86339cc7e, user_id=57b8a1f3d0064b199c0a994aa92958a7, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.414246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-ece85abf-0464-4d93-b5ef-96938ac8c46d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:01:21.414246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 19:01:21.414246 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 19:01:21.416248 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece85abf-0464-4d93-b5ef-96938ac8c46d admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.424673 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c727b-e8d9-49bf-b39b-29c15725ff54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d154d489c3b7403cac96ff091b186ee4, user_id=da7b33ab0e854680bfcde4348b65b6ee, role_id=ae946283d08e403cba50982b7ee3d73a)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.427302 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c727b-e8d9-49bf-b39b-29c15725ff54 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.429176 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 593/1177] 10.222.0.72 () {60 vars in 1482 bytes} [Thu Jul 14 19:01:21 2022] PUT /identity/v3/projects/0d466c96198746409cfc1ed86339cc7e/users/57b8a1f3d0064b199c0a994aa92958a7/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:01:21.434926 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f42b0-d921-42a7-b26c-d1cd82706a02 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.435219 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f42b0-d921-42a7-b26c-d1cd82706a02 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.435503 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f42b0-d921-42a7-b26c-d1cd82706a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.440757 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 585/1178] 10.222.0.72 () {60 vars in 1482 bytes} [Thu Jul 14 19:01:21 2022] PUT /identity/v3/projects/d154d489c3b7403cac96ff091b186ee4/users/da7b33ab0e854680bfcde4348b65b6ee/roles/ae946283d08e403cba50982b7ee3d73a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 19:01:21.446266 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b3b-3f39-453d-9211-41583c29e163 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.446559 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b3b-3f39-453d-9211-41583c29e163 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.446841 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b3b-3f39-453d-9211-41583c29e163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.452614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-677f42b0-d921-42a7-b26c-d1cd82706a02 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:21.453824 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-677f42b0-d921-42a7-b26c-d1cd82706a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:21.465627 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-74925b3b-3f39-453d-9211-41583c29e163 None None] MFA Rules not processed for user `0d863b3bf1f7404a89e5e672973c4874`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:21.466802 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-74925b3b-3f39-453d-9211-41583c29e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:21.494785 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:21.509521 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:21.514437 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 594/1179] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:21.525145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f42b0-d921-42a7-b26c-d1cd82706a02 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.531254 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 586/1180] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:21.541150 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925b3b-3f39-453d-9211-41583c29e163 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:21.581044 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f42b0-d921-42a7-b26c-d1cd82706a02 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.584633 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69927f3-8117-4897-baab-3e0a54a396f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.585359 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69927f3-8117-4897-baab-3e0a54a396f4 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.585654 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69927f3-8117-4897-baab-3e0a54a396f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.585939 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69927f3-8117-4897-baab-3e0a54a396f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.594990 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925b3b-3f39-453d-9211-41583c29e163 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:21.595594 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69927f3-8117-4897-baab-3e0a54a396f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.597074 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69927f3-8117-4897-baab-3e0a54a396f4 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.598783 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:21.599422 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:21.599712 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:21.599995 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:21.606436 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 595/1181] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 19:01:21.609179 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:21.610608 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:21.620496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 587/1182] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 19:01:27.723974 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa45e6-3f1d-4b83-9392-525c1e1ba1f8 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:27.724636 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa45e6-3f1d-4b83-9392-525c1e1ba1f8 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:27.724862 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa45e6-3f1d-4b83-9392-525c1e1ba1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:27.758791 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-40aa45e6-3f1d-4b83-9392-525c1e1ba1f8 None None] MFA Rules not processed for user `da7b33ab0e854680bfcde4348b65b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:27.763351 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-40aa45e6-3f1d-4b83-9392-525c1e1ba1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:27.859193 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 596/1183] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:27 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:27.863416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:27.880160 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de9d6-bde8-4ac4-8d91-554478bdb1ac service neutron] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:27.887454 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf82d05-24cd-429c-b6cf-e5bf76a94dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:27.888447 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82d05-24cd-429c-b6cf-e5bf76a94dba admin admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:27.888736 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82d05-24cd-429c-b6cf-e5bf76a94dba admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:27.889028 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf82d05-24cd-429c-b6cf-e5bf76a94dba admin admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:27.889714 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf82d05-24cd-429c-b6cf-e5bf76a94dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:27.892809 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf82d05-24cd-429c-b6cf-e5bf76a94dba admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:27.932893 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 588/1184] 10.222.0.72 () {60 vars in 1152 bytes} [Thu Jul 14 19:01:27 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 19:01:27.936885 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa45e6-3f1d-4b83-9392-525c1e1ba1f8 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:27.949080 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa45e6-3f1d-4b83-9392-525c1e1ba1f8 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.033772 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.035530 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.036039 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.036513 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] PATH_INFO: `/v3/users` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.037971 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.042942 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.062759 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e558f-fb12-40bc-acce-06ba41ec5e9d None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.063467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e558f-fb12-40bc-acce-06ba41ec5e9d None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.063810 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e558f-fb12-40bc-acce-06ba41ec5e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.080168 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 597/1185] 10.222.0.72 () {60 vars in 1143 bytes} [Thu Jul 14 19:01:27 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 19:01:28.081357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.094537 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dbfbb-da20-4e7b-9d4e-d33a2dac396e admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.099162 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-166e558f-fb12-40bc-acce-06ba41ec5e9d None None] MFA Rules not processed for user `57b8a1f3d0064b199c0a994aa92958a7`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:28.100452 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-166e558f-fb12-40bc-acce-06ba41ec5e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:28.102576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.103313 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.103669 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.104416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.105292 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.106961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.110577 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:28.124394 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 598/1186] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 19:01:28.125738 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.140963 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6ea9-f22b-4e13-96b8-5f7d76099eec admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.147060 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.147961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.148276 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.148641 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] PATH_INFO: `/v3/projects/0567e436477f46adbe233d1a3fac8522/users/8c86294d569a45a594b4d686f061b529/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.173275 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0567e436477f46adbe233d1a3fac8522, user_id=8c86294d569a45a594b4d686f061b529, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.177330 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.186667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 589/1187] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:28 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:28.192358 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e558f-fb12-40bc-acce-06ba41ec5e9d None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.205200 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e558f-fb12-40bc-acce-06ba41ec5e9d None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.216092 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 599/1188] 10.222.0.72 () {60 vars in 1482 bytes} [Thu Jul 14 19:01:28 2022] PUT /identity/v3/projects/0567e436477f46adbe233d1a3fac8522/users/8c86294d569a45a594b4d686f061b529/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 19:01:28.217436 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.282125 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:28.289800 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.290794 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.291470 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.292066 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] PATH_INFO: `/v3/projects` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.293055 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.295823 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.312825 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f940-0fce-4cb1-a5f6-dc0ea09eeab6 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.327366 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.328212 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.328619 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.329000 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.329844 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.331980 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.334534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 590/1189] 10.222.0.72 () {60 vars in 1152 bytes} [Thu Jul 14 19:01:28 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 19:01:28.338466 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.344849 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 600/1190] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 19:01:28.348768 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.362319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75eed-4da0-405d-8170-ed84a46925ee admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.443052 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08cd50-694b-4db9-aa31-0c9df18a3537 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.445306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.446237 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] REQUEST_METHOD: `PUT` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.446515 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.446792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] PATH_INFO: `/v3/projects/0567e436477f46adbe233d1a3fac8522/users/8c86294d569a45a594b4d686f061b529/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.449223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0567e436477f46adbe233d1a3fac8522, user_id=8c86294d569a45a594b4d686f061b529, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.452245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.468876 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.469555 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.469840 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.472210 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 601/1191] 10.222.0.72 () {60 vars in 1482 bytes} [Thu Jul 14 19:01:28 2022] PUT /identity/v3/projects/0567e436477f46adbe233d1a3fac8522/users/8c86294d569a45a594b4d686f061b529/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:01:28.472346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] PATH_INFO: `/v3/users` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.473027 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.481541 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.507579 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 591/1192] 10.222.0.72 () {60 vars in 1143 bytes} [Thu Jul 14 19:01:28 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 19:01:28.511646 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.587749 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f92e02-793c-47e6-8850-20eaa81e8198 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.593152 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.593590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.594794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.594794 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.595023 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.596792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.603256 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:28.613344 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.619984 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 602/1193] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 19:01:28.624156 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618b9d-8b97-4d18-a4da-8a822c786494 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.635368 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.638936 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.639400 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.640160 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] PATH_INFO: `/v3/projects/40a1f9cd8c8f4a8f8e54d756a40dab0a/users/4dc84409e2d5492e9aea3330e2641eb4/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.688930 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a1f9cd8c8f4a8f8e54d756a40dab0a, user_id=4dc84409e2d5492e9aea3330e2641eb4, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.692098 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.715268 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 592/1194] 10.222.0.72 () {60 vars in 1482 bytes} [Thu Jul 14 19:01:28 2022] PUT /identity/v3/projects/40a1f9cd8c8f4a8f8e54d756a40dab0a/users/4dc84409e2d5492e9aea3330e2641eb4/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 19:01:28.719414 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.730517 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e5ee3-3c15-48ce-bfc8-487e0f97eb7e admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.809294 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86d20d-c77b-45ee-bf45-959aaabee839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.809761 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86d20d-c77b-45ee-bf45-959aaabee839 admin admin] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.810124 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86d20d-c77b-45ee-bf45-959aaabee839 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.810479 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86d20d-c77b-45ee-bf45-959aaabee839 admin admin] PATH_INFO: `/v3/roles` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.811405 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86d20d-c77b-45ee-bf45-959aaabee839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.813192 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86d20d-c77b-45ee-bf45-959aaabee839 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.826120 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 603/1195] 10.222.0.72 () {58 vars in 1121 bytes} [Thu Jul 14 19:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 19:01:28.830031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:28.842667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22bcd-8dc1-4226-865f-3b08b371edf5 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:28.849173 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e2438-f845-413e-b8c7-03dea371dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:28.849862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e2438-f845-413e-b8c7-03dea371dff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:28.850147 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e2438-f845-413e-b8c7-03dea371dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:28.850428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e2438-f845-413e-b8c7-03dea371dff2 admin admin] PATH_INFO: `/v3/projects/40a1f9cd8c8f4a8f8e54d756a40dab0a/users/4dc84409e2d5492e9aea3330e2641eb4/roles/03bbcd5f75d045b49c031083f6d3fbce` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:28.852557 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e2438-f845-413e-b8c7-03dea371dff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a1f9cd8c8f4a8f8e54d756a40dab0a, user_id=4dc84409e2d5492e9aea3330e2641eb4, role_id=03bbcd5f75d045b49c031083f6d3fbce)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:28.855390 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e2438-f845-413e-b8c7-03dea371dff2 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:28.876821 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 593/1196] 10.222.0.72 () {60 vars in 1482 bytes} [Thu Jul 14 19:01:28 2022] PUT /identity/v3/projects/40a1f9cd8c8f4a8f8e54d756a40dab0a/users/4dc84409e2d5492e9aea3330e2641eb4/roles/03bbcd5f75d045b49c031083f6d3fbce => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:01:35.626003 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:35.626490 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:35.626585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:35.696399 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] MFA Rules not processed for user `8c86294d569a45a594b4d686f061b529`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:35.698704 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:35.775693 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:35.776250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:35.776460 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:35.815695 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 604/1197] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:35 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:35.818205 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] MFA Rules not processed for user `4dc84409e2d5492e9aea3330e2641eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:35.819296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:35.829116 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:35.831358 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:35.920352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05bee1-602e-431a-9f8e-0abad74f306f None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:35.922955 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 594/1198] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:35 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:35.928630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b52fb-2640-4090-988f-7fec038b5666 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19eb91529e945489e4df71b2e07bd31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:35.929306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b52fb-2640-4090-988f-7fec038b5666 service glance] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:35.930159 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b52fb-2640-4090-988f-7fec038b5666 service glance] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:35.930568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b52fb-2640-4090-988f-7fec038b5666 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:35.931474 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:35.932988 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:35.945610 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7ccc-c38f-4d58-b83c-73dfa7a5e0bd None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:35.949059 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072950db-1610-418a-952a-945f43acfa4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19eb91529e945489e4df71b2e07bd31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:35.950336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072950db-1610-418a-952a-945f43acfa4a service glance] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:35.950336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072950db-1610-418a-952a-945f43acfa4a service glance] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:35.950336 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072950db-1610-418a-952a-945f43acfa4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:35.958628 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=100 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:35.974606 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:36.002845 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b52fb-2640-4090-988f-7fec038b5666 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:36.004773 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b52fb-2640-4090-988f-7fec038b5666 service glance] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:36.014967 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 605/1199] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:35 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:36.025425 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072950db-1610-418a-952a-945f43acfa4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:36.027290 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072950db-1610-418a-952a-945f43acfa4a service glance] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:36.037948 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 595/1200] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:35 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 19:01:44.391709 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fccead-eb5f-4ec1-95ae-6fc3f2a7be78 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:44.392675 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fccead-eb5f-4ec1-95ae-6fc3f2a7be78 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:44.393145 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fccead-eb5f-4ec1-95ae-6fc3f2a7be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:44.410225 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-e2fccead-eb5f-4ec1-95ae-6fc3f2a7be78 None None] MFA Rules not processed for user `57b8a1f3d0064b199c0a994aa92958a7`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:44.411436 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-e2fccead-eb5f-4ec1-95ae-6fc3f2a7be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:44.418526 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 606/1201] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:01:44 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:44.738341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4bd0-f807-476e-88ac-425be6fbc3ef None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:44.744813 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4bd0-f807-476e-88ac-425be6fbc3ef None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:44.745101 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4bd0-f807-476e-88ac-425be6fbc3ef None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:44.746568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 596/1202] 10.222.0.72 () {54 vars in 961 bytes} [Thu Jul 14 19:01:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:01:44.753056 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b618c-ea68-43fa-8919-11beaf45883b None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:44.753775 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b618c-ea68-43fa-8919-11beaf45883b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:44.753973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b618c-ea68-43fa-8919-11beaf45883b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:44.787630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-241b618c-ea68-43fa-8919-11beaf45883b None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:44.789346 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-241b618c-ea68-43fa-8919-11beaf45883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:44.873842 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 607/1203] 10.222.0.72 () {58 vars in 1058 bytes} [Thu Jul 14 19:01:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:44.879332 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34bf8-6c74-4b33-bc46-e197573615e7 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:44.879946 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34bf8-6c74-4b33-bc46-e197573615e7 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:44.880480 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34bf8-6c74-4b33-bc46-e197573615e7 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:44.881867 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 597/1204] 10.222.0.72 () {54 vars in 912 bytes} [Thu Jul 14 19:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:01:44.887899 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe999-dfba-494d-94d0-433fdb372acf None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:44.888311 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe999-dfba-494d-94d0-433fdb372acf None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:44.888823 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe999-dfba-494d-94d0-433fdb372acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:44.911481 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-523fe999-dfba-494d-94d0-433fdb372acf None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:44.913428 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-523fe999-dfba-494d-94d0-433fdb372acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:44.924589 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 608/1205] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Jul 14 19:01:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:44.937568 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34bf8-6c74-4b33-bc46-e197573615e7 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:44.950424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34bf8-6c74-4b33-bc46-e197573615e7 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:44.954621 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a57fc-ce81-419f-beab-bb1acaff9f37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19eb91529e945489e4df71b2e07bd31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:44.955467 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a57fc-ce81-419f-beab-bb1acaff9f37 service glance] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:44.955755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a57fc-ce81-419f-beab-bb1acaff9f37 service glance] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:44.956032 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a57fc-ce81-419f-beab-bb1acaff9f37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:44.967267 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a57fc-ce81-419f-beab-bb1acaff9f37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:44.968769 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a57fc-ce81-419f-beab-bb1acaff9f37 service glance] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:44.978738 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 598/1206] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:45.319299 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694a5d5-683f-4fcd-a03f-d1f6de56300b None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.320243 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694a5d5-683f-4fcd-a03f-d1f6de56300b None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.320559 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694a5d5-683f-4fcd-a03f-d1f6de56300b None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.321965 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 609/1207] 10.222.0.72 () {54 vars in 912 bytes} [Thu Jul 14 19:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:01:45.327399 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f0c36-08db-44f0-ae05-765b6741190a None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.327695 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f0c36-08db-44f0-ae05-765b6741190a None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.327975 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f0c36-08db-44f0-ae05-765b6741190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.362217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-de2f0c36-08db-44f0-ae05-765b6741190a None None] MFA Rules not processed for user `a159b191ad424a8b9452cd957385b0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:45.363442 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-de2f0c36-08db-44f0-ae05-765b6741190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:45.416327 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 599/1208] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Jul 14 19:01:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:45.427792 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694a5d5-683f-4fcd-a03f-d1f6de56300b None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:45.439089 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694a5d5-683f-4fcd-a03f-d1f6de56300b None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:45.442630 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e063e1-0416-47a2-8ab5-524369f15fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:45.443265 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e063e1-0416-47a2-8ab5-524369f15fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.443554 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e063e1-0416-47a2-8ab5-524369f15fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.443833 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e063e1-0416-47a2-8ab5-524369f15fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.452335 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e063e1-0416-47a2-8ab5-524369f15fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:45.453874 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e063e1-0416-47a2-8ab5-524369f15fb1 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:45.462333 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 610/1209] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:45 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:45.856245 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81172-c04e-4dac-bc3b-23431d8bd57b None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.857054 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81172-c04e-4dac-bc3b-23431d8bd57b None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.857493 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81172-c04e-4dac-bc3b-23431d8bd57b None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.859324 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 600/1210] 10.222.0.72 () {54 vars in 961 bytes} [Thu Jul 14 19:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:01:45.865267 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3597-b5fd-4dc0-922c-0abbd25044ea None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.865758 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3597-b5fd-4dc0-922c-0abbd25044ea None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.866241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3597-b5fd-4dc0-922c-0abbd25044ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.880758 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236fda-6186-467a-a024-083a15a66021 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.881056 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236fda-6186-467a-a024-083a15a66021 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.881348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236fda-6186-467a-a024-083a15a66021 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.882920 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 601/1211] 10.222.0.72 () {54 vars in 960 bytes} [Thu Jul 14 19:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 19:01:45.897267 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104453-d8ce-4813-8dcb-c8c47e3ef127 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.898317 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104453-d8ce-4813-8dcb-c8c47e3ef127 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.898674 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104453-d8ce-4813-8dcb-c8c47e3ef127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.912796 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-f5ba3597-b5fd-4dc0-922c-0abbd25044ea None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:45.914476 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-f5ba3597-b5fd-4dc0-922c-0abbd25044ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:45.921505 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-52104453-d8ce-4813-8dcb-c8c47e3ef127 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:45.922691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-52104453-d8ce-4813-8dcb-c8c47e3ef127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:45.924783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 611/1212] 10.222.0.72 () {58 vars in 1058 bytes} [Thu Jul 14 19:01:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:45.930379 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21ac1-b5c5-4929-ad55-3b2fa1b4cc03 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.930671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21ac1-b5c5-4929-ad55-3b2fa1b4cc03 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.930958 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21ac1-b5c5-4929-ad55-3b2fa1b4cc03 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.932306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 612/1213] 10.222.0.72 () {54 vars in 912 bytes} [Thu Jul 14 19:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 19:01:45.936954 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b288a-4f7e-45ff-acf7-39961394595a None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.937245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b288a-4f7e-45ff-acf7-39961394595a None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.937660 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b288a-4f7e-45ff-acf7-39961394595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.956705 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-2b4b288a-4f7e-45ff-acf7-39961394595a None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:45.957899 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-2b4b288a-4f7e-45ff-acf7-39961394595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:45.967538 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 613/1214] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Jul 14 19:01:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:45.980392 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b288a-4f7e-45ff-acf7-39961394595a None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:45.990171 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b288a-4f7e-45ff-acf7-39961394595a None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:45.993936 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7780eb-79e9-42e9-950e-da29a14007df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:45.994626 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7780eb-79e9-42e9-950e-da29a14007df service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:45.994918 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7780eb-79e9-42e9-950e-da29a14007df service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:45.995199 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7780eb-79e9-42e9-950e-da29a14007df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:45.998285 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 602/1215] 10.222.0.72 () {58 vars in 1057 bytes} [Thu Jul 14 19:01:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:01:46.006608 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7780eb-79e9-42e9-950e-da29a14007df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:46.008305 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7780eb-79e9-42e9-950e-da29a14007df service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:46.010650 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104453-d8ce-4813-8dcb-c8c47e3ef127 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:46.019575 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 614/1216] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 19:01:46.021090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104453-d8ce-4813-8dcb-c8c47e3ef127 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:46.026732 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:46.027378 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:46.027660 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:46.027935 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:46.029806 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:46.042141 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:46.044113 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:46.057248 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 603/1217] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 19:01:56.014520 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=74 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:56.051258 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=88 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:59.387816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b67e66-00b9-4f62-9830-49ad19a02a78 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:59.388423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b67e66-00b9-4f62-9830-49ad19a02a78 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:59.388423 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b67e66-00b9-4f62-9830-49ad19a02a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:59.406383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-b2b67e66-00b9-4f62-9830-49ad19a02a78 None None] MFA Rules not processed for user `a159b191ad424a8b9452cd957385b0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:01:59.407631 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-b2b67e66-00b9-4f62-9830-49ad19a02a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:59.415084 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 615/1218] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Jul 14 19:01:59 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:01:59.427383 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:01:59.429473 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:01:59.440817 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65946944-c396-4e04-96a6-42690fecfb46 service placement] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:01:59.445042 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8651a1-ea11-4cbd-837b-4c6cb68f58c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:01:59.445768 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8651a1-ea11-4cbd-837b-4c6cb68f58c5 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:01:59.446064 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8651a1-ea11-4cbd-837b-4c6cb68f58c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:01:59.446344 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8651a1-ea11-4cbd-837b-4c6cb68f58c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:01:59.453836 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8651a1-ea11-4cbd-837b-4c6cb68f58c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:01:59.455284 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8651a1-ea11-4cbd-837b-4c6cb68f58c5 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:01:59.463438 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 604/1219] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:01:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:02:00.369236 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7fa9-9e5c-443b-8b83-defad7a32d3c None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:00.369534 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7fa9-9e5c-443b-8b83-defad7a32d3c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:00.369798 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7fa9-9e5c-443b-8b83-defad7a32d3c None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:00.371264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 616/1220] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 19:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:02:00.413198 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa5ba-4868-4c89-ae2c-5b95c43f3f2c None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:00.413507 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa5ba-4868-4c89-ae2c-5b95c43f3f2c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:00.413755 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa5ba-4868-4c89-ae2c-5b95c43f3f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:00.436045 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-230aa5ba-4868-4c89-ae2c-5b95c43f3f2c None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:02:00.437413 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-230aa5ba-4868-4c89-ae2c-5b95c43f3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:02:00.449341 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 605/1221] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 19:02:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:02:00.468081 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad7fa9-9e5c-443b-8b83-defad7a32d3c None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:02:00.487525 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad7fa9-9e5c-443b-8b83-defad7a32d3c None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:02:00.493149 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872b323-067e-48c7-8c6e-371e8d7c174b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:02:00.493806 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b323-067e-48c7-8c6e-371e8d7c174b service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:00.494155 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b323-067e-48c7-8c6e-371e8d7c174b service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:00.494443 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b323-067e-48c7-8c6e-371e8d7c174b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:00.503239 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872b323-067e-48c7-8c6e-371e8d7c174b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:02:00.504881 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872b323-067e-48c7-8c6e-371e8d7c174b service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:02:00.515111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 617/1222] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:02:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:02:07.468318 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b843-9dbe-4761-927b-b534484b6b52 None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:07.469209 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b843-9dbe-4761-927b-b534484b6b52 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:07.469787 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b843-9dbe-4761-927b-b534484b6b52 None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:07.471839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 606/1223] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 19:02:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:02:07.481128 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d56c7-1826-4d13-8c99-2442ae4c4e2c None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:07.481671 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d56c7-1826-4d13-8c99-2442ae4c4e2c None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:07.481889 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d56c7-1826-4d13-8c99-2442ae4c4e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:07.501909 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-146d56c7-1826-4d13-8c99-2442ae4c4e2c None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:02:07.503190 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-146d56c7-1826-4d13-8c99-2442ae4c4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:02:07.512635 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 618/1224] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 19:02:07 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:02:07.529346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b843-9dbe-4761-927b-b534484b6b52 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:02:07.545739 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b843-9dbe-4761-927b-b534484b6b52 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:02:07.550987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059a81d-1b8f-449c-8d5b-092e0f672788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:02:07.551647 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a81d-1b8f-449c-8d5b-092e0f672788 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:07.551931 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a81d-1b8f-449c-8d5b-092e0f672788 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:07.552231 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a81d-1b8f-449c-8d5b-092e0f672788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:07.561379 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059a81d-1b8f-449c-8d5b-092e0f672788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:02:07.563158 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059a81d-1b8f-449c-8d5b-092e0f672788 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:02:07.573546 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 607/1225] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:02:07 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:02:17.496024 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=12 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:02:17.569348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=15 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:02:21.471425 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d56c7-1826-4d13-8c99-2442ae4c4e2c None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:02:21.480662 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d56c7-1826-4d13-8c99-2442ae4c4e2c None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:02:21.484150 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67be69-dad5-4e54-877b-437bc931a7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:02:21.484820 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67be69-dad5-4e54-877b-437bc931a7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:21.485111 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67be69-dad5-4e54-877b-437bc931a7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:21.485393 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67be69-dad5-4e54-877b-437bc931a7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:21.494571 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67be69-dad5-4e54-877b-437bc931a7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:02:21.496087 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67be69-dad5-4e54-877b-437bc931a7d9 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:02:21.505763 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 619/1226] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:02:21 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:02:25.669007 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701641a-3669-4c08-9bfd-61a6e0d1e7fc None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:25.670676 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701641a-3669-4c08-9bfd-61a6e0d1e7fc None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:25.671329 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701641a-3669-4c08-9bfd-61a6e0d1e7fc None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:25.673025 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 608/1227] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 19:02:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:02:25.730482 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443daf-42ee-464a-9d49-ab1622dd78fa None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:25.730994 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443daf-42ee-464a-9d49-ab1622dd78fa None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:25.731099 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443daf-42ee-464a-9d49-ab1622dd78fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:25.764979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-37443daf-42ee-464a-9d49-ab1622dd78fa None None] MFA Rules not processed for user `6baca856645346b39ef5a3ec8f052891`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:02:25.766317 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-37443daf-42ee-464a-9d49-ab1622dd78fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:02:25.789253 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 620/1228] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 19:02:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:02:25.825982 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701641a-3669-4c08-9bfd-61a6e0d1e7fc None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:02:25.886261 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701641a-3669-4c08-9bfd-61a6e0d1e7fc None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:02:25.918744 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0649f-9fdb-4d77-b738-1a009c7f03d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:02:25.922494 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0649f-9fdb-4d77-b738-1a009c7f03d0 service nova] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:25.928830 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0649f-9fdb-4d77-b738-1a009c7f03d0 service nova] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:25.930894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0649f-9fdb-4d77-b738-1a009c7f03d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:26.048723 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0649f-9fdb-4d77-b738-1a009c7f03d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:02:26.051334 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0649f-9fdb-4d77-b738-1a009c7f03d0 service nova] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:02:26.092175 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 609/1229] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:02:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:02:32.631533 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a663e-aecd-40bb-8528-854730a30c25 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:02:32.632062 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a663e-aecd-40bb-8528-854730a30c25 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:02:32.632156 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a663e-aecd-40bb-8528-854730a30c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:02:32.649888 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-7a4a663e-aecd-40bb-8528-854730a30c25 None None] MFA Rules not processed for user `da7b33ab0e854680bfcde4348b65b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:02:32.651760 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7a4a663e-aecd-40bb-8528-854730a30c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:02:32.658576 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 621/1230] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:02:32 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:02:36.080226 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=6 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:02:42.644689 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=12 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:03:00.767874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0a8d4-e5e2-4d08-942b-810bacb771ff None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:03:00.768355 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0a8d4-e5e2-4d08-942b-810bacb771ff None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:03:00.768449 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0a8d4-e5e2-4d08-942b-810bacb771ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:03:00.786246 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-0ce0a8d4-e5e2-4d08-942b-810bacb771ff None None] MFA Rules not processed for user `da7b33ab0e854680bfcde4348b65b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:03:00.787450 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-0ce0a8d4-e5e2-4d08-942b-810bacb771ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:03:00.795161 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 610/1231] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:03:00 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:03:10.781517 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:03:16.348684 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd710e7e-f8c2-4d91-b775-08e8777c1c14 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:03:16.349152 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd710e7e-f8c2-4d91-b775-08e8777c1c14 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:03:16.349255 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd710e7e-f8c2-4d91-b775-08e8777c1c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:03:16.366337 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-cd710e7e-f8c2-4d91-b775-08e8777c1c14 None None] MFA Rules not processed for user `da7b33ab0e854680bfcde4348b65b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:03:16.367539 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-cd710e7e-f8c2-4d91-b775-08e8777c1c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:03:16.374956 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 622/1232] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:03:16 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:03:26.361301 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=3 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:04:15.906416 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a19fe-c889-4a3a-bf26-1c52838dd371 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:04:15.906904 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a19fe-c889-4a3a-bf26-1c52838dd371 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:04:15.906996 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a19fe-c889-4a3a-bf26-1c52838dd371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:04:15.923872 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-824a19fe-c889-4a3a-bf26-1c52838dd371 None None] MFA Rules not processed for user `da7b33ab0e854680bfcde4348b65b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:04:15.925075 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-824a19fe-c889-4a3a-bf26-1c52838dd371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:04:15.931853 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 611/1233] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:04:15 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:04:16.243250 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574a80-de6c-4fe8-8a81-0f9a35092f88 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:04:16.243754 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574a80-de6c-4fe8-8a81-0f9a35092f88 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:04:16.243855 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574a80-de6c-4fe8-8a81-0f9a35092f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:04:16.289189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-f5574a80-de6c-4fe8-8a81-0f9a35092f88 None None] MFA Rules not processed for user `a159b191ad424a8b9452cd957385b0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:04:16.290402 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-f5574a80-de6c-4fe8-8a81-0f9a35092f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:04:16.306642 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 623/1234] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Jul 14 19:04:16 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:04:16.318410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a19fe-c889-4a3a-bf26-1c52838dd371 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:04:16.327748 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a19fe-c889-4a3a-bf26-1c52838dd371 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:04:16.331278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:04:16.332090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:04:16.332282 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:04:16.332612 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:04:16.340312 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:04:16.341748 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:04:16.350278 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 612/1235] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:04:16 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:04:26.303734 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=17 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:04:26.346747 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=9 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:04:28.659698 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5574a80-de6c-4fe8-8a81-0f9a35092f88 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:04:28.667919 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5574a80-de6c-4fe8-8a81-0f9a35092f88 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:04:28.671767 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:04:28.673029 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:04:28.673313 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:04:28.673591 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:04:28.682279 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:04:28.683736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:04:28.693040 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 624/1236] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:04:28 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:04:38.689480 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=6 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:05:35.028874 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:05:35.050558 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4377e-8889-47a3-9b81-8bc347ad6e15 service neutron] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:05:35.055410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09c305-aa66-49a9-b691-67dc798ef777 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:05:35.056036 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c305-aa66-49a9-b691-67dc798ef777 service placement] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:05:35.056355 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c305-aa66-49a9-b691-67dc798ef777 service placement] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:05:35.056637 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c305-aa66-49a9-b691-67dc798ef777 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:05:35.065440 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09c305-aa66-49a9-b691-67dc798ef777 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:05:35.067001 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09c305-aa66-49a9-b691-67dc798ef777 service placement] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:05:35.076534 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 613/1237] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:05:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:05:45.072619 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=10 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:06:35.614595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:06:35.635869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba13d5b-4ca6-4440-9ecd-4bae5edd2e45 service neutron] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:06:35.640767 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:06:35.641400 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:06:35.641683 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:06:35.641960 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:06:35.650235 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:06:35.651816 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:06:35.660461 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 625/1238] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:06:35 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:06:40.433323 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a176e-eb13-4e95-859f-e1f9de2ae1ed None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:06:40.433779 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a176e-eb13-4e95-859f-e1f9de2ae1ed None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:06:40.433863 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a176e-eb13-4e95-859f-e1f9de2ae1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:06:40.451571 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-156a176e-eb13-4e95-859f-e1f9de2ae1ed None None] MFA Rules not processed for user `da7b33ab0e854680bfcde4348b65b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:06:40.452800 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-156a176e-eb13-4e95-859f-e1f9de2ae1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:06:40.459573 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 614/1239] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:06:40 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:06:45.656609 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=10 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:06:45.882727 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:06:45.891558 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4909-a5e6-4bd4-a057-ac07f063539d service nova] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:06:45.895049 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:06:45.895675 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:06:45.895958 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:06:45.896268 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:06:45.905397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:06:45.906839 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:06:45.917005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 626/1240] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:06:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 19:06:47.087702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a176e-eb13-4e95-859f-e1f9de2ae1ed None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:06:47.096960 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a176e-eb13-4e95-859f-e1f9de2ae1ed None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:06:47.101031 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:06:47.101671 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:06:47.101957 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:06:47.102233 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:06:47.111572 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:06:47.113061 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:06:47.123108 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 615/1241] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:06:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:06:55.912600 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=6 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:06:57.118808 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=9 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:06:58.469142 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:06:58.480123 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d03c-7b90-4b74-9e56-df081671523d service neutron] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:06:58.485136 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:06:58.485773 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:06:58.486061 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:06:58.486340 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:06:58.493973 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:06:58.495585 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:06:58.504294 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 627/1242] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:06:58 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:06:59.605255 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:06:59.614280 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37c8b-444b-4d32-8636-25f43684a204 service neutron] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:06:59.618215 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f0814-9c55-45c5-b86a-621b1f309bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:06:59.618862 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f0814-9c55-45c5-b86a-621b1f309bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:06:59.619148 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f0814-9c55-45c5-b86a-621b1f309bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:06:59.619594 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f0814-9c55-45c5-b86a-621b1f309bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:06:59.627250 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f0814-9c55-45c5-b86a-621b1f309bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:06:59.628731 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f0814-9c55-45c5-b86a-621b1f309bf4 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:06:59.637451 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 616/1243] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:06:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:07:05.463659 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:07:05.476779 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8d7b-441c-4e10-97ff-10efb81289b2 service nova] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:07:05.482093 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:07:05.482748 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:07:05.483068 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:07:05.483566 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:07:05.493700 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:07:05.495320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:07:05.505389 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 628/1244] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:07:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:07:09.633841 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=6 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:13.930641 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6290ff-846b-489b-96ad-6da4b8a2af93 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:07:13.931236 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6290ff-846b-489b-96ad-6da4b8a2af93 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:07:13.931236 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6290ff-846b-489b-96ad-6da4b8a2af93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:07:13.948691 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-ce6290ff-846b-489b-96ad-6da4b8a2af93 None None] MFA Rules not processed for user `57b8a1f3d0064b199c0a994aa92958a7`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:07:13.949895 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-ce6290ff-846b-489b-96ad-6da4b8a2af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:07:13.956727 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 617/1245] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:07:13 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:07:14.207825 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:07:14.216757 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433cc2-5273-439f-bad8-5ed9d6d816fd service nova] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:07:14.220298 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:07:14.220936 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:07:14.221223 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:07:14.221502 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:07:14.228461 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:07:14.229880 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:07:14.237569 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 629/1246] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:07:14 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:07:14.545099 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6290ff-846b-489b-96ad-6da4b8a2af93 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:07:14.557666 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6290ff-846b-489b-96ad-6da4b8a2af93 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:07:14.562818 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:07:14.563476 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:07:14.563762 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:07:14.564041 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:07:14.573155 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:07:14.574742 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:07:14.585174 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 618/1247] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:07:14 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:07:24.234241 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=18 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:24.580903 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=9 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:33.117639 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:07:33.141401 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211cc1-3a5e-496e-8479-a942948620d0 service neutron] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:07:33.147416 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:07:33.148531 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:07:33.149614 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:07:33.150143 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:07:33.161568 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:07:33.163352 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:07:33.175684 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 630/1248] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:07:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:07:41.182984 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:07:41.193515 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63375d6e-fa75-4cbc-8dbc-9ec519c8239c service placement] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:07:41.198241 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64747d-7104-4ac6-b582-1aa02c0ba3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:07:41.198949 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64747d-7104-4ac6-b582-1aa02c0ba3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:07:41.199348 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64747d-7104-4ac6-b582-1aa02c0ba3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:07:41.199654 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64747d-7104-4ac6-b582-1aa02c0ba3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:07:41.209320 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64747d-7104-4ac6-b582-1aa02c0ba3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:07:41.211118 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64747d-7104-4ac6-b582-1aa02c0ba3b4 service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:07:41.221883 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 619/1249] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:07:41 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:07:43.170228 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=6 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:44.708783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:07:44.722086 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ae76a-3ec5-4430-b378-56c8a49af9ad service nova] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:07:44.730495 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6baca856645346b39ef5a3ec8f052891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:07:44.731397 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:07:44.732001 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:07:44.732511 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:07:44.743953 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:07:44.745820 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:07:44.758439 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 631/1250] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:07:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:07:51.217346 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=6 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:54.752843 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=6 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:48.141397 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdbe57-b5a4-4cec-b8f8-ee4df0ee30b1 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:08:48.141897 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdbe57-b5a4-4cec-b8f8-ee4df0ee30b1 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:08:48.141993 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdbe57-b5a4-4cec-b8f8-ee4df0ee30b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:08:48.159986 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-50fdbe57-b5a4-4cec-b8f8-ee4df0ee30b1 None None] MFA Rules not processed for user `da7b33ab0e854680bfcde4348b65b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:08:48.161220 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-50fdbe57-b5a4-4cec-b8f8-ee4df0ee30b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:08:48.167969 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 620/1251] 10.222.0.72 () {58 vars in 957 bytes} [Thu Jul 14 19:08:48 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:08:58.154918 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:25.710592 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:25.712209 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:10:25.753407 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957fe0d-6a0a-4cf2-b672-45bf0356391a service nova] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:25.757055 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266eb576-e87a-4739-be73-2cd4231c9f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:25.757694 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266eb576-e87a-4739-be73-2cd4231c9f3c service neutron] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:25.757984 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266eb576-e87a-4739-be73-2cd4231c9f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:25.758266 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266eb576-e87a-4739-be73-2cd4231c9f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:25.845204 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266eb576-e87a-4739-be73-2cd4231c9f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:25.846581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266eb576-e87a-4739-be73-2cd4231c9f3c service neutron] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:25.864912 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 632/1252] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:10:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:10:28.971698 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffea45-f828-4afa-85af-e56012a0699c None None] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:28.972296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffea45-f828-4afa-85af-e56012a0699c None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:28.972296 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffea45-f828-4afa-85af-e56012a0699c None None] PATH_INFO: `/` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:28.973667 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 621/1253] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 19:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:10:28.980275 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be89a2-af86-47f5-b710-e864e46dc6f1 None None] REQUEST_METHOD: `POST` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:28.980697 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be89a2-af86-47f5-b710-e864e46dc6f1 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:28.980992 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be89a2-af86-47f5-b710-e864e46dc6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:29.049277 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.auth.core [None req-f2be89a2-af86-47f5-b710-e864e46dc6f1 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:10:29.050896 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-f2be89a2-af86-47f5-b710-e864e46dc6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:10:29.060190 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 633/1254] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 19:10:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 19:10:29.071565 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffea45-f828-4afa-85af-e56012a0699c None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:29.085721 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffea45-f828-4afa-85af-e56012a0699c None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:29.090680 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac49b9-0584-4a82-998d-619fbbe835e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:29.091347 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac49b9-0584-4a82-998d-619fbbe835e2 service placement] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:29.091631 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac49b9-0584-4a82-998d-619fbbe835e2 service placement] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:29.091919 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac49b9-0584-4a82-998d-619fbbe835e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:29.101319 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac49b9-0584-4a82-998d-619fbbe835e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:29.102881 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac49b9-0584-4a82-998d-619fbbe835e2 service placement] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:29.114676 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 622/1255] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:10:29 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:10:32.589306 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a48e-d4c6-4103-8497-fff2581ced27 None None] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:32.589945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a48e-d4c6-4103-8497-fff2581ced27 None None] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:32.589945 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a48e-d4c6-4103-8497-fff2581ced27 None None] PATH_INFO: `/` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:32.591222 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 634/1256] 10.222.0.72 () {54 vars in 921 bytes} [Thu Jul 14 19:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 19:10:32.623613 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee949b8-1b83-4eab-9f0c-b6c1295ce488 None None] REQUEST_METHOD: `POST` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:32.624174 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee949b8-1b83-4eab-9f0c-b6c1295ce488 None None] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:32.624174 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee949b8-1b83-4eab-9f0c-b6c1295ce488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:32.642834 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.auth.core [None req-5ee949b8-1b83-4eab-9f0c-b6c1295ce488 None None] MFA Rules not processed for user `c253a979e80b4aa889db8fba1ac875f1`. Rule list: `[]` (Enabled: `True`). {{(pid=120841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 19:10:32.644080 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-5ee949b8-1b83-4eab-9f0c-b6c1295ce488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:10:32.655180 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 623/1257] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Jul 14 19:10:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 19:10:32.661240 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960a48e-d4c6-4103-8497-fff2581ced27 None None] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:32.676840 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960a48e-d4c6-4103-8497-fff2581ced27 None None] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:32.682080 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:32.683096 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:32.683382 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee949b8-1b83-4eab-9f0c-b6c1295ce488 None None] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:32.683508 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:32.683857 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] PATH_INFO: `/v3/users/57b8a1f3d0064b199c0a994aa92958a7` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:32.685395 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b8a1f3d0064b199c0a994aa92958a7)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:32.686583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: WARNING py.warnings [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:10:32.686583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: warnings.warn(msg) Jul 14 19:10:32.686583 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: Jul 14 19:10:32.687837 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:32.694934 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee949b8-1b83-4eab-9f0c-b6c1295ce488 None None] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:32.700585 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:32.701531 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:32.701915 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:32.702287 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:32.711424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:32.713268 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:32.723987 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 624/1258] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:10:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:10:32.751832 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:32.757052 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b8a1f3d0064b199c0a994aa92958a7'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:32.757877 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b8a1f3d0064b199c0a994aa92958a7'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:32.758783 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b8a1f3d0064b199c0a994aa92958a7'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:32.766208 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b8a1f3d0064b199c0a994aa92958a7'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:32.776869 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b8a1f3d0064b199c0a994aa92958a7'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:32.804162 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 635/1259] 10.222.0.72 () {58 vars in 1223 bytes} [Thu Jul 14 19:10:32 2022] DELETE /identity/v3/users/57b8a1f3d0064b199c0a994aa92958a7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:10:33.017134 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:33.027868 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa08674-de22-4b65-9c3f-38632a53bad7 service placement] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:33.085428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:33.086297 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:33.086575 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:33.086899 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] PATH_INFO: `/v3/projects/0d466c96198746409cfc1ed86339cc7e` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:33.088068 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d466c96198746409cfc1ed86339cc7e)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:33.089109 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: WARNING py.warnings [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:10:33.089109 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: warnings.warn(msg) Jul 14 19:10:33.089109 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: Jul 14 19:10:33.090286 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:33.150222 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d466c96198746409cfc1ed86339cc7e', 'request_id': 'req-bcd2a96b-1c3e-4042-a798-768599c9cdf1'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.156894 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d466c96198746409cfc1ed86339cc7e', 'request_id': 'req-bcd2a96b-1c3e-4042-a798-768599c9cdf1'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.170217 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d466c96198746409cfc1ed86339cc7e', 'request_id': 'req-bcd2a96b-1c3e-4042-a798-768599c9cdf1'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.195226 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] The token cache is being invalidate because project 0d466c96198746409cfc1ed86339cc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=120841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 19:10:33.195522 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.196169 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.197765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 625/1260] 10.222.0.72 () {58 vars in 1232 bytes} [Thu Jul 14 19:10:33 2022] DELETE /identity/v3/projects/0d466c96198746409cfc1ed86339cc7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:10:33.202518 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:33.204245 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:10:33.217805 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0da6f4-0bf0-47a5-bfb7-ef250e37fdfb admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:33.274264 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:33.275160 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:33.275445 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:33.275724 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] PATH_INFO: `/v3/users/4dc84409e2d5492e9aea3330e2641eb4` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:33.276961 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc84409e2d5492e9aea3330e2641eb4)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:33.278925 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:33.326101 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc84409e2d5492e9aea3330e2641eb4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.327308 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc84409e2d5492e9aea3330e2641eb4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.327910 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc84409e2d5492e9aea3330e2641eb4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.336046 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc84409e2d5492e9aea3330e2641eb4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.344005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc84409e2d5492e9aea3330e2641eb4'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.361411 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 636/1261] 10.222.0.72 () {58 vars in 1223 bytes} [Thu Jul 14 19:10:33 2022] DELETE /identity/v3/users/4dc84409e2d5492e9aea3330e2641eb4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 19:10:33.538750 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:33.540216 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:10:33.555109 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a96b-1c3e-4042-a798-768599c9cdf1 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:33.598765 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:33.614246 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:33.615112 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:33.615424 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:33.615702 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] PATH_INFO: `/v3/projects/40a1f9cd8c8f4a8f8e54d756a40dab0a` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:33.616907 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a1f9cd8c8f4a8f8e54d756a40dab0a)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:33.618839 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:33.663583 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a1f9cd8c8f4a8f8e54d756a40dab0a', 'request_id': 'req-416da374-193b-4fb8-a75a-7af188bc4d80'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.668995 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a1f9cd8c8f4a8f8e54d756a40dab0a', 'request_id': 'req-416da374-193b-4fb8-a75a-7af188bc4d80'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.675679 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a1f9cd8c8f4a8f8e54d756a40dab0a', 'request_id': 'req-416da374-193b-4fb8-a75a-7af188bc4d80'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.687949 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] The token cache is being invalidate because project 40a1f9cd8c8f4a8f8e54d756a40dab0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=120841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 19:10:33.688260 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.688882 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:10:33.690406 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 626/1262] 10.222.0.72 () {58 vars in 1232 bytes} [Thu Jul 14 19:10:33 2022] DELETE /identity/v3/projects/40a1f9cd8c8f4a8f8e54d756a40dab0a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:10:39.957189 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:10:39.958626 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:10:40.001934 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:40.027581 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66d2e4-a682-44fb-95da-38885a239557 admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:10:40.084736 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:10:40.085376 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:10:40.085664 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:10:40.085941 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:10:40.087708 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:10:40.098814 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:10:40.100419 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:10:40.110322 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 637/1263] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:10:39 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:10:43.684496 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:50.105914 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=40 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:26.643437 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:11:26.645299 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:11:26.702658 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416da374-193b-4fb8-a75a-7af188bc4d80 admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:11:26.706798 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a159b191ad424a8b9452cd957385b0cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:11:26.707441 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] REQUEST_METHOD: `GET` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:11:26.707726 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:11:26.708004 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:11:26.709779 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:11:26.770365 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:11:26.771804 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:11:26.781251 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 627/1264] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:11:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:11:32.612091 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:11:32.613742 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:11:32.629033 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b02e-b317-42fe-b0c3-39a01d1f6a34 service placement] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:11:32.633652 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:11:32.634537 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:11:32.634827 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:11:32.635106 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] PATH_INFO: `/v3/users/da7b33ab0e854680bfcde4348b65b6ee` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:11:32.650567 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7b33ab0e854680bfcde4348b65b6ee)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:11:32.652590 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:11:32.707817 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7b33ab0e854680bfcde4348b65b6ee'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:32.708536 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7b33ab0e854680bfcde4348b65b6ee'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:32.709144 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7b33ab0e854680bfcde4348b65b6ee'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:32.716258 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7b33ab0e854680bfcde4348b65b6ee'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:32.723319 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7b33ab0e854680bfcde4348b65b6ee'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:32.740251 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 638/1265] 10.222.0.72 () {58 vars in 1223 bytes} [Thu Jul 14 19:11:32 2022] DELETE /identity/v3/users/da7b33ab0e854680bfcde4348b65b6ee => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:11:32.908999 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:11:32.919410 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf6b43-c425-4bfc-b6e0-462d6ba8158c service neutron] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:11:32.978939 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:11:32.979753 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] REQUEST_METHOD: `DELETE` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:11:32.980040 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:11:32.980355 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] PATH_INFO: `/v3/projects/d154d489c3b7403cac96ff091b186ee4` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:11:32.991201 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d154d489c3b7403cac96ff091b186ee4)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:11:32.993204 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:11:33.034051 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:33.038221 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd154d489c3b7403cac96ff091b186ee4', 'request_id': 'req-7a775544-8aa5-4397-9454-3031d7cb12de'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.044642 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd154d489c3b7403cac96ff091b186ee4', 'request_id': 'req-7a775544-8aa5-4397-9454-3031d7cb12de'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.052532 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd154d489c3b7403cac96ff091b186ee4', 'request_id': 'req-7a775544-8aa5-4397-9454-3031d7cb12de'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.066512 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] The token cache is being invalidate because project d154d489c3b7403cac96ff091b186ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=120841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 19:11:33.066800 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.067428 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.069090 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 628/1266] 10.222.0.72 () {58 vars in 1232 bytes} [Thu Jul 14 19:11:32 2022] DELETE /identity/v3/projects/d154d489c3b7403cac96ff091b186ee4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:11:33.073174 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:11:33.074582 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:11:33.087314 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb8555-d9a6-483d-9a26-798827019d7f admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:11:33.142112 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:11:33.143034 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:11:33.143320 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:11:33.143615 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] PATH_INFO: `/v3/users/8c86294d569a45a594b4d686f061b529` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:11:33.157979 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c86294d569a45a594b4d686f061b529)` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:11:33.159926 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:11:33.204747 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c86294d569a45a594b4d686f061b529'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.205395 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c86294d569a45a594b4d686f061b529'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.206005 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c86294d569a45a594b4d686f061b529'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.209456 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:33.214355 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c86294d569a45a594b4d686f061b529'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.223859 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.notifications [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c86294d569a45a594b4d686f061b529'} {{(pid=120840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.241281 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 639/1267] 10.222.0.72 () {58 vars in 1223 bytes} [Thu Jul 14 19:11:33 2022] DELETE /identity/v3/users/8c86294d569a45a594b4d686f061b529 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:11:33.421448 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Authenticating user token {{(pid=120841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:11:33.422999 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.fernet_utils [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:11:33.436956 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775544-8aa5-4397-9454-3031d7cb12de admin admin] Validating token access rules against request {{(pid=120841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:11:33.494093 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d863b3bf1f7404a89e5e672973c4874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6df883a091541ef907c5fc4143c65b5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:11:33.494982 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:11:33.495269 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] SCRIPT_NAME: `/identity` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:11:33.495544 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] PATH_INFO: `/v3/projects/0567e436477f46adbe233d1a3fac8522` {{(pid=120841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:11:33.505710 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0567e436477f46adbe233d1a3fac8522)` {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:11:33.507644 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] RBAC: Authorization granted {{(pid=120841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:11:33.562724 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0567e436477f46adbe233d1a3fac8522', 'request_id': 'req-7fcd2eae-4d67-4155-be54-81274c0ae78a'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.568166 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0567e436477f46adbe233d1a3fac8522', 'request_id': 'req-7fcd2eae-4d67-4155-be54-81274c0ae78a'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.574705 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0567e436477f46adbe233d1a3fac8522', 'request_id': 'req-7fcd2eae-4d67-4155-be54-81274c0ae78a'} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.587208 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] The token cache is being invalidate because project 0567e436477f46adbe233d1a3fac8522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=120841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 19:11:33.587502 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.588131 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG keystone.notifications [None req-7fcd2eae-4d67-4155-be54-81274c0ae78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=120841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 19:11:33.589711 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: [pid: 120841|app: 0|req: 629/1268] 10.222.0.72 () {58 vars in 1232 bytes} [Thu Jul 14 19:11:33 2022] DELETE /identity/v3/projects/0567e436477f46adbe233d1a3fac8522 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 19:11:43.237819 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:43.584391 dv-osbrick-849891-3-ceph devstack@keystone.service[120841]: DEBUG dbcounter [-] [120841] Writing DB stats keystone:SELECT=63,keystone:DELETE=11,keystone:INSERT=2 {{(pid=120841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:43.914167 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Authenticating user token {{(pid=120840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 19:15:43.915597 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:15:43.992383 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee7de7-cf99-42bb-a7a0-708a40812a0c admin admin] Validating token access rules against request {{(pid=120840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 19:15:44.049357 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572a8a1-b831-4608-9d19-1b6a00c1edad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c253a979e80b4aa889db8fba1ac875f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1e951324636416eb0436eea3812cafd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 19:15:44.050006 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572a8a1-b831-4608-9d19-1b6a00c1edad service placement] REQUEST_METHOD: `GET` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 19:15:44.050295 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572a8a1-b831-4608-9d19-1b6a00c1edad service placement] SCRIPT_NAME: `/identity` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 19:15:44.050584 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572a8a1-b831-4608-9d19-1b6a00c1edad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=120840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 19:15:44.052453 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.fernet_utils [None req-1572a8a1-b831-4608-9d19-1b6a00c1edad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=120840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 19:15:44.063387 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572a8a1-b831-4608-9d19-1b6a00c1edad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 19:15:44.064997 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572a8a1-b831-4608-9d19-1b6a00c1edad service placement] RBAC: Authorization granted {{(pid=120840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 19:15:44.074595 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: [pid: 120840|app: 0|req: 640/1269] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Jul 14 19:15:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 19:15:54.070563 dv-osbrick-849891-3-ceph devstack@keystone.service[120840]: DEBUG dbcounter [-] [120840] Writing DB stats keystone:SELECT=62 {{(pid=120840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}